-- Logs begin at Mon 2022-09-12 14:56:53 UTC, end at Mon 2022-09-12 15:56:52 UTC. -- Sep 12 15:22:37.027414 dv-cinder-851996-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 12 15:22:37.036719 dv-cinder-851996-10-smb devstack@keystone.service[81324]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 15:22:37 2022] *** Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: nodename: dv-cinder-851996-10-smb Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: machine: x86_64 Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: clock source: unix Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: pcre jit disabled Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: detected number of CPU cores: 4 Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: current working directory: / Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: detected binary path: /usr/bin/uwsgi-core Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: your processes number limit is 47680 Sep 12 15:22:37.038744 dv-cinder-851996-10-smb devstack@keystone.service[81324]: your memory page size is 4096 bytes Sep 12 15:22:37.039411 dv-cinder-851996-10-smb devstack@keystone.service[81324]: detected max file descriptor number: 2048 Sep 12 15:22:37.039411 dv-cinder-851996-10-smb devstack@keystone.service[81324]: lock engine: pthread robust mutexes Sep 12 15:22:37.039411 dv-cinder-851996-10-smb devstack@keystone.service[81324]: thunder lock: enabled Sep 12 15:22:37.039411 dv-cinder-851996-10-smb devstack@keystone.service[81324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 12 15:22:37.039411 dv-cinder-851996-10-smb devstack@keystone.service[81324]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 15:22:37.077548 dv-cinder-851996-10-smb devstack@keystone.service[81324]: Python main interpreter initialized at 0x5601879da9c0 Sep 12 15:22:37.077548 dv-cinder-851996-10-smb devstack@keystone.service[81324]: python threads support enabled Sep 12 15:22:37.077548 dv-cinder-851996-10-smb devstack@keystone.service[81324]: your server socket listen backlog is limited to 100 connections Sep 12 15:22:37.077548 dv-cinder-851996-10-smb devstack@keystone.service[81324]: your mercy for graceful operations on workers is 90 seconds Sep 12 15:22:37.077908 dv-cinder-851996-10-smb devstack@keystone.service[81324]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 15:22:37.077989 dv-cinder-851996-10-smb devstack@keystone.service[81324]: *** Operational MODE: preforking *** Sep 12 15:22:37.078225 dv-cinder-851996-10-smb devstack@keystone.service[81324]: *** uWSGI is running in multiple interpreter mode *** Sep 12 15:22:37.078225 dv-cinder-851996-10-smb devstack@keystone.service[81324]: spawned uWSGI master process (pid: 81324) Sep 12 15:22:37.078409 dv-cinder-851996-10-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 12 15:22:37.079206 dv-cinder-851996-10-smb devstack@keystone.service[81324]: spawned uWSGI worker 1 (pid: 81335, cores: 1) Sep 12 15:22:37.079374 dv-cinder-851996-10-smb devstack@keystone.service[81324]: spawned uWSGI worker 2 (pid: 81336, cores: 1) Sep 12 15:22:37.080541 dv-cinder-851996-10-smb devstack@keystone.service[81324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 15:22:41.333285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 15:22:41.333285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: from cryptography.utils import int_from_bytes Sep 12 15:22:41.334122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 15:22:41.334122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: from cryptography.utils import int_from_bytes Sep 12 15:22:41.350758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 15:22:41.350758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: from cryptography.utils import int_from_bytes Sep 12 15:22:41.351220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 15:22:41.351220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: from cryptography.utils import int_from_bytes Sep 12 15:22:41.383168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 15:22:41.383358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 15:22:41.383549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] command line args: [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 15:22:41.383842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 15:22:41.384017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ================================================================================ {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 15:22:41.384763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] admin_token = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.385020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] config_dir = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.385207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.385388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] config_source = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.385571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] debug = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.385786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.386279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.386377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.386569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.386811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_config_append = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_dir = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_file = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.387967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.388210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.388451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.388693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.388870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.389044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.389284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.389524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.389777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.390009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.390237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.390465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.390706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.390970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.391241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.391717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.391896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] publish_errors = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.392124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.392349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.392524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.392765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.392994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.393225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] standard_threads = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.393450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.393686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.393884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.394057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] use_journal = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.394229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] use_json = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.394402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] use_stderr = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.394573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] use_syslog = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.394800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.395109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.395350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.395604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.395839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.396081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.396315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.396557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.396790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.397033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.397274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.397520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.397766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.398011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.398220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 15:22:41.398305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.398418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 15:22:41.398507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.398617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] command line args: [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 15:22:41.398696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.398889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 15:22:41.398969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.399065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ================================================================================ {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 15:22:41.399141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.399317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] admin_token = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.399401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.399565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] config_dir = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.399643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.399754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.399838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.399983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] config_source = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.400948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] debug = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.401031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.401161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.401321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.401405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.401477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.401569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.401704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.401850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.401942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.402103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.402181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.402336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.402413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.402548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_config_append = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.402624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.402694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.402837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.402916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_dir = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.403011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_file = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.403095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.403249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.403326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.403498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.403575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.403741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.403829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.403986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.404065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.404165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.404250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.404342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.404449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.404587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.404672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.404834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.404912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.405070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.405155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.405305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.405382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.405538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.405621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.405781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.405877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.406010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.406089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.406243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.406326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.406486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.406572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.406715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.406949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.407026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.407177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] publish_errors = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.407260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.407404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.407482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.407634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.407786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.407867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.407938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.408054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.408139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.408292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.408382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.408528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] standard_threads = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.408606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.408759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.408836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.408992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.409078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.409349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] use_journal = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.409510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] use_json = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.409788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] use_stderr = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] use_syslog = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.409961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 15:22:41.410195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.410927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.411881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.412977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.413941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.414966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.415974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.416949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.417932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.418909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.419844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.420940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.external = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.421980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.password = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] auth.token = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.422922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.423864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.424971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.425947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.426927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.427962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.428903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.429877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.430991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.431968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.432978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.433915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.434874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.external = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.435974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.password = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.436987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] auth.token = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.437952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.438881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.439946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.440947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.441948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.442961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.443912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.444999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.445950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.446757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.447981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.448921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.449892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.450980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.451996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.452945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.453937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] role.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] role.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.454999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.455953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.456982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.457952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.458950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.459982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.460936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.461902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.462063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.462142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.462295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.462374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.463860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.464974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.465942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.466979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.467928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.connection = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.468899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.469996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] role.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] role.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.470947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.471963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.472114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.472193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.472284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 15:22:41.472372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.472616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.472852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.473103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.473353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.473603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.473878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.474272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.474514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.474767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.475023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.475276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.475527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.475765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.476023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.476280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.476527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.476763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.476997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.477233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.477486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.477768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.478028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.478279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.478519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.478755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.478994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.479235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.479486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.479725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.479984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.480235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.480476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.480725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.480969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.481220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.481458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.481699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.481962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.482212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.482498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.482732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.482981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.483247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.483510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.connection = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.483758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.484010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.484251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.484496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.484736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.484976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.485214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.485454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.485703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.485966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.486213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.486457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.486707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.486945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.487191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.487423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.487665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.487903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 15:22:41.488076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 15:22:41.501089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.501321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.501545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.510301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.513287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.513523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.513769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.522034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.538529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.538757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.540931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.541165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.592372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.592695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.641127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.641354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.641856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.642094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.796874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.797006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.797090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.797222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.797307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.797435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.820716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.820962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.821621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.822976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.833689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.833800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.846961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.847814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 15:22:41.864697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.864903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 15:22:41.865246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.865450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 15:22:41.865750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.865850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.865968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 15:22:41.866052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.866260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.866341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.866500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 15:22:41.866582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.866778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.867045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.867310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.867573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.876569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.876848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.877120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.877403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.877674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.877981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.878256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.878541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.885097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.886086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.888007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.888294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.888577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.888860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.888993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.889144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.889974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.890979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.891254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.891530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.891801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.913274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.914588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.914765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.915047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.917325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.917615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.920291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.920581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.920865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.922393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.922683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.922981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.927149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.927433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.929366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.929658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.933519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.933900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.934197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.934486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.934765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.935044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.935319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.935589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.935961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.936264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.936561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.936853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.937133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.937412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.937686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.937985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.950768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.951048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.953318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.953602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.954884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.957387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.958055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.958354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.960586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.960890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.962494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.965063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.965596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.968146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.968804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.969104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.969389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.969675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.969986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.970280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.971335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.971640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.971927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.972214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.972495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.972777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.986469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.986756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.987028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.987290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.988740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:41.989036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.989309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.989579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.994586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.996124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.996926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.997644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.997951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.998463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:41.999968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.000251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.000687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.000985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.001268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.001549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.001966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.002963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.003269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.003560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.003849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.004249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.012984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.013267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.013545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.013849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.014235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.014515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.014808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.015400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.015689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.015975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.016259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.016643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.016929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.017212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.030279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.032846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.033145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.035761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.036028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.037470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.038657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.038950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.039231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.039622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.040101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.042130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.042434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.042832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.046441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.047885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.049180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.050675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.050805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.051135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.051422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.051700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.053546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.053983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.054275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.054556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.059995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.060285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.060565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.062992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.063289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.063577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.067387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.067671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.067953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.068230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.068506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.068784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.069057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.069331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.069599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.069903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.070181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.070441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.070575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 15:22:42.070709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.070843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.070967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.071099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.071280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.071566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.071871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.072153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.072437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.072722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.073003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.073292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.073560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.073854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.074122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 15:22:42.104988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5601879da9c0 pid: 81335 (default app) Sep 12 15:22:42.108224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803501-db07-4d6c-897c-20f7d31f6603 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:42.108510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803501-db07-4d6c-897c-20f7d31f6603 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:42.108636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5601879da9c0 pid: 81336 (default app) Sep 12 15:22:42.108775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43803501-db07-4d6c-897c-20f7d31f6603 None None] PATH_INFO: `/v3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:42.112865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Sep 12 15:22:42 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:22:48.822871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:48.823417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:48.823417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:48.827630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:22:48.833141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:48.833648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:48.833770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:48.904321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: INFO dbcounter [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] Registered counter for database keystone Sep 12 15:22:48.923483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG oslo_db.sqlalchemy.engines [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 15:22:48.929604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writer thread running {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 15:22:49.120522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG passlib.handlers.bcrypt [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 15:22:49.120913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG passlib.handlers.bcrypt [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 15:22:49.178316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:49.179942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:49.305202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 12 15:22:49.784666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:49.852099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: INFO dbcounter [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] Registered counter for database keystone Sep 12 15:22:49.873313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG oslo_db.sqlalchemy.engines [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 15:22:49.879340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writer thread running {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 15:22:49.996681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376f17c-c156-400a-873d-0b5c5880566f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:50.000843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:50.001455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:50.001747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:50.002020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:50.010066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:50.061190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 15:22:50.061523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cce7a-be3c-4f35-9c16-f4fa348d7190 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:50.070528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 12 15:22:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 15:22:50.076521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:50.093589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5243b-db2a-4c35-9dc0-f094800fdc3d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:50.097972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:50.099080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:50.099361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:50.099629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] PATH_INFO: `/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:50.101231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=27ae4d0f7c2945c3a5c26ee841ef1a26)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:50.153625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 15:22:50.153987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9fbe9-5c65-4166-902b-8a00cafcdbf8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:50.158444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Sep 12 15:22:50 2022] GET /identity/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:22:52.257106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f535ea-345a-4fc5-a2dd-efcca5d3db06 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:52.257617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f535ea-345a-4fc5-a2dd-efcca5d3db06 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:52.257697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f535ea-345a-4fc5-a2dd-efcca5d3db06 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:52.262509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:22:52.267922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:52.268347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:52.268440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:52.288609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:52.290230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:52.297787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 15:22:52.560674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f535ea-345a-4fc5-a2dd-efcca5d3db06 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:52.572967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f535ea-345a-4fc5-a2dd-efcca5d3db06 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:52.577113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:52.577706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:52.578011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:52.578285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:52.585777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:52.588124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723dc3-a902-4375-9445-664dde18afef admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:52.596622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 12 15:22:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:22:52.601684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:52.610542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2607-461f-4c3d-98b3-bc675af02b5a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:52.614734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:52.615345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:52.615623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:52.615895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:52.617176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:52.619051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb3c21-ae7e-45db-800b-cfbdd230b068 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:52.620540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Sep 12 15:22:52 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:22:54.822053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9138-b926-4eef-a92d-92a9d4d2a166 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:54.822563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9138-b926-4eef-a92d-92a9d4d2a166 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:54.822672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf9138-b926-4eef-a92d-92a9d4d2a166 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:54.823908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:22:54.828977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:54.829386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:54.829649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:54.844959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fece-99a9-4456-b7f6-b7618af1767e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:54.845322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fece-99a9-4456-b7f6-b7618af1767e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:54.845659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fece-99a9-4456-b7f6-b7618af1767e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:54.847027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:22:54.847678 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:54.848931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:54.851980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:54.852265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:54.853061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:54.893913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG passlib.handlers.bcrypt [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 15:22:54.894296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG passlib.handlers.bcrypt [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 15:22:54.929487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:22:54.944966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:54.947779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:55.054673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:22:55.192886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.216879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.296424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999a61f-24d6-41b4-b7eb-696bd51e5d6f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.317339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.328515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.329149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.329429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.329710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.341887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:22:55.351216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:22:55.352195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:22:55.353764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:22:55.358827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.436515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead56fc3-95ec-43ef-8ad3-7819c42cdf21 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.438889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.441832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.460864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0462f6-a30c-41a3-b8ff-93607fe95c94 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.474315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.475196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.475547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.475884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.494566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.495167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.495442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.495711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.496379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:22:55.496676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.498081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.510000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:55.515380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.543443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.544963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.610775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f351ca4-6aa7-4074-87f8-619e897ccf6c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.639194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 15:22:55.643467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.644242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.644518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.644747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.644837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.645989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.647411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.647529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.649052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:55.654779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.670577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.755082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cf1e4-d2bd-414c-a806-c6eec9473a8a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.760872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43353ff3-1ad4-4799-9916-b98491bf9e27 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.788309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.789153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.789520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.789705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.796778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.797394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.797673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.797977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.799080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.800524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.802079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:55.807758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.808561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.810033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:22:55.827832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:22:55.829363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:22:55.830346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:22:55.830346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:22:55.830346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:22:55.830346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:22:55.834541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:55.886277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.889165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:55.906077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e8ae-e774-4f38-b16c-1380f92b3743 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.934341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c723-e26e-435e-ac27-78294b805368 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:55.939514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.940129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.940408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.940679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.941399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.domain.id=default, user.id=3fd5e886cff94b13acb51e443452da3f) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:22:55.941708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.943185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec38abe-0f9d-40c2-a021-27377fd014b4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.949692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/role_assignments?user.id=3fd5e886cff94b13acb51e443452da3f&scope.domain.id=default&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:55.967197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:55.967828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:55.968107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:55.968378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:55.969033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:22:55.969334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:55.971696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab67abc-bd4e-4c3f-a55f-62e875ecb330 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:55.990410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:58.408074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a607-263f-4c4b-8e7a-598768ffbac5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.408583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a607-263f-4c4b-8e7a-598768ffbac5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.408680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8a607-263f-4c4b-8e7a-598768ffbac5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.410048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:22:58.416232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1801a8-2dae-4ad0-83ac-ef7b852fbe13 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.416720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1801a8-2dae-4ad0-83ac-ef7b852fbe13 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.416796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1801a8-2dae-4ad0-83ac-ef7b852fbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.444466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2a1801a8-2dae-4ad0-83ac-ef7b852fbe13 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:58.445803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2a1801a8-2dae-4ad0-83ac-ef7b852fbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:58.535337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:22:58.746504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-6fee-461f-a806-4f0c0748391f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.747174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-6fee-461f-a806-4f0c0748391f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.747654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-6fee-461f-a806-4f0c0748391f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.749373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:22:58.755343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b66338-0533-4018-8a1e-208dc2a3caa6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.755979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b66338-0533-4018-8a1e-208dc2a3caa6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.756463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b66338-0533-4018-8a1e-208dc2a3caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.786797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-31b66338-0533-4018-8a1e-208dc2a3caa6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:58.788335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-31b66338-0533-4018-8a1e-208dc2a3caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:58.840397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:58.870184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:22:58.883208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf43de-f6ae-49d2-931d-75000ce4b09e None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.883542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf43de-f6ae-49d2-931d-75000ce4b09e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.884373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf43de-f6ae-49d2-931d-75000ce4b09e None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.885824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 14/26] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:22:58.899512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb42b4-9035-4b61-a36b-58bb86eadce9 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:58.900487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb42b4-9035-4b61-a36b-58bb86eadce9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:58.900903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb42b4-9035-4b61-a36b-58bb86eadce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:58.931217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ccbb42b4-9035-4b61-a36b-58bb86eadce9 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:58.932624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ccbb42b4-9035-4b61-a36b-58bb86eadce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:58.968146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf43de-f6ae-49d2-931d-75000ce4b09e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.035820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:22:59.037377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1dcd5-3122-4083-9f36-eec110859c6f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.037864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1dcd5-3122-4083-9f36-eec110859c6f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.038283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1dcd5-3122-4083-9f36-eec110859c6f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.040278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 14/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:22:59.051964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.052476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.053342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.083265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:22:59.085281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:22:59.157277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 15/29] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:22:59.194408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf43de-f6ae-49d2-931d-75000ce4b09e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.235205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.235762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.236041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.236315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.255377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:22:59.260721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:22:59.261601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:22:59.262392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:22:59.268939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.316080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:59.388227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8d1b6-b042-445f-a800-4808324237d4 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.423518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.424939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.425479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.425970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.426832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:22:59.427334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:59.428911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:59.431179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.439713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:59.444616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 16/31] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:22:59.456187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.559608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:59.563416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6e808-2387-46e9-af68-a6e0d7a66484 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.593615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758616d7-159c-4dfc-b225-23431fb09cdb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.600457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.601307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.601697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.602080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.603840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:59.605493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:59.607381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:22:59 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:22:59.608149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.631089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.631975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.632442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.632958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.645201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:59.647135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:22:59.663611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:22:59.664488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:22:59.665323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:22:59.665323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:22:59.665323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:22:59.667191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 16/33] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:22:59.673085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.731034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e78da-17eb-406f-a639-ad2432c5cab3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.733660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:59.770873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.771805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.772256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.772671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.773588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:59.776065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:59.780564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba0d-7597-43f6-8743-77a957e400e3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:22:59.817017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:22:59.817577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:22:59.817893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:22:59.818173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:22:59.818901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:22:59.820290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:22:59.911638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 18/34] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 15:22:59 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:22:59.912856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:22:59.947920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:22:59.957801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 15:22:59 2022] POST /identity/v3/roles => generated 219 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:22:59.959340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:00.060139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c74df2-a80f-498f-b747-19bde7190657 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:00.129191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3507fc6-7fd6-414d-9dc9-bdd0b7b2c2d8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:00.151503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:00.153660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:00.154723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.155220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.155726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.161763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:00.165422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:00.167448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 19/36] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:00.173315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:00.176251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:00.181756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:00.208807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 18/37] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:00.215353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:00.331949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:00.343468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08d7dc-e562-4d9f-880a-e51c04dc7caf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:00.352917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9ff88-9749-4ca7-a19e-484cf1319d31 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:00.397956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:00.398533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.398809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.399711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] PATH_INFO: `/v3/domains/default/users/3fd5e886cff94b13acb51e443452da3f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.402078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3fd5e886cff94b13acb51e443452da3f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:00.403432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:00.403552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2a431-0fb0-4bf4-a4ba-1f467d8050ca None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:00.404367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.404858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.405337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.406230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:00.408143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222c7b-e288-4b40-9557-78a3f418af6b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:00.425268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Sep 12 15:23:00 2022] PUT /identity/v3/domains/default/users/3fd5e886cff94b13acb51e443452da3f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:23:00.451165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:23:00 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:00.498259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06280-2c21-478e-b42c-84048069e014 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.498602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06280-2c21-478e-b42c-84048069e014 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.498823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc06280-2c21-478e-b42c-84048069e014 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.500259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 21/40] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:00.506561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.507168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.507672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.511783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb505db-fe85-4c2f-a9b2-eb5d567b4c1e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.512119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb505db-fe85-4c2f-a9b2-eb5d567b4c1e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.512398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb505db-fe85-4c2f-a9b2-eb5d567b4c1e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.514342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 22/41] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:00.519963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:00.520295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:00.520512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:00.535363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:00.537689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:00.543892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:00.545608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:00.571707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:00.628339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 23/42] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:00.646622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:00.891156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:00.922841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:00.977869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:00.996268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a79ada-0939-4778-892f-c44e35ca3322 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:01.032090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:01.032315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ad174-6214-458f-8c23-7c59f0bc0404 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:01.032702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:01.032978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:01.033247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:01.033940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:01.035317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:01.049998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 24/44] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 15:23:00 2022] POST /identity/v3/roles => generated 223 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:01.074285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:01.075004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:01.075292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:01.075565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:01.076889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:01.078436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7afca-62ae-4b5b-a354-25ac3b3cc6e2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:01.080331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 21/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:01.085952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:01.198011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5f50-36de-4aa5-b94a-9cb0c74cf32d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:01.237121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:01.237662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:01.238003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:01.238277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:01.238929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:01.240386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76392f8-ef9f-4479-89ed-33d08ec7cb82 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:01.259253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:01.275444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 25/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:23:01 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:02.676309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8bee-2aae-48cb-ba55-570cdf0d19fc None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:02.676862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8bee-2aae-48cb-ba55-570cdf0d19fc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:02.676862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8bee-2aae-48cb-ba55-570cdf0d19fc None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:02.678222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 22/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:02.683480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254001db-749b-424e-92c9-bb496a67f889 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:02.683890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254001db-749b-424e-92c9-bb496a67f889 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:02.684045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254001db-749b-424e-92c9-bb496a67f889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:02.701952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-254001db-749b-424e-92c9-bb496a67f889 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:02.703129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-254001db-749b-424e-92c9-bb496a67f889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:02.766307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:03.036539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d8bee-2aae-48cb-ba55-570cdf0d19fc None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.064278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:03.249246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d8bee-2aae-48cb-ba55-570cdf0d19fc None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.282057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.282693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.282978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.283253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.294439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-65fa2d53-736f-46ab-a6eb-d4678f95f571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:03.299410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:03.300302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:03.301035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 23/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:03.307027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254001db-749b-424e-92c9-bb496a67f889 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.407795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254001db-749b-424e-92c9-bb496a67f889 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.422921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569edb-41a1-4dd0-aeae-f14db52108c5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.423206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569edb-41a1-4dd0-aeae-f14db52108c5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.423484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa569edb-41a1-4dd0-aeae-f14db52108c5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.424874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 24/50] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:03.430793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.431077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.431353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.450547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:03.451786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:03.525239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 25/51] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:03.535761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:03.545051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.545596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.545909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.546181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.546835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:03.547135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:03.548496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:03.556383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:03.561994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.579048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:03.657696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7b62b-d1c9-40fb-8249-00d9e16d1924 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.690530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.691153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.691430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.691698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.692813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:03.694284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:03.696047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:03.701272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.794442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.797101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef0f70-990c-499a-857a-20a661e4e220 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.831053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.831673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.831951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.832225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.833323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:03.834801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:03.836347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:03.841998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.881188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:03.897242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920e83-6c8b-4feb-8176-88ffe504033a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.899371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:03.931909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.932535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.932816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.933087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.934216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:03.935664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:03.937212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:03.942670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:03.943032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c39f46-09d4-4b65-80c5-5c72cc180e05 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:03.974991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:03.975589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:03.975875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:03.976144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:03.976859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.domain.id=default, user.id=3fd5e886cff94b13acb51e443452da3f) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:03.977655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:03.979108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe766b-7bac-49e3-ae85-0741e8146e5f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:03.987164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 12 15:23:03 2022] GET /identity/v3/role_assignments?user.id=3fd5e886cff94b13acb51e443452da3f&scope.domain.id=default&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:04.049402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf39983-a8bc-43a9-ac47-b0406d9dfa95 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:04.084803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:04.085415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:04.085688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:04.085984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:04.087194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:04.088657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a407c66-e3d7-4f94-9a90-51ca9b545001 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:04.116666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 12 15:23:03 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:23:06.284678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811c4e-083d-409d-ba6a-c005fdc68383 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:06.285202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811c4e-083d-409d-ba6a-c005fdc68383 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:06.285307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811c4e-083d-409d-ba6a-c005fdc68383 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:06.286615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:06.291794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:06.292178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:06.292351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:06.299569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:06.312102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:06.313287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:06.377522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:06.648056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811c4e-083d-409d-ba6a-c005fdc68383 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:06.747211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811c4e-083d-409d-ba6a-c005fdc68383 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:06.766322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:06.780466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:06.781099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:06.781380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:06.781655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:06.782786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:06.784237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e53b5-1621-44e3-a793-a21e6ca4a379 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:06.785814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:06.791735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:06.888352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3246f-ab24-4f94-9669-fff8a54f6657 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:06.920677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:06.921210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:06.921489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:06.921781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:06.922433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:06.923852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289831c-c8f6-43a3-bf3c-d29b0db3b0ae None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:06.934075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:06.950785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:06 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:10.296170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3616cb-2b81-4bd4-bf57-d37db62a29a1 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.296705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3616cb-2b81-4bd4-bf57-d37db62a29a1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.296705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3616cb-2b81-4bd4-bf57-d37db62a29a1 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.298062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:10.303316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9da2-fe85-4e57-95c9-ebf14c1bf60a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.304114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9da2-fe85-4e57-95c9-ebf14c1bf60a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.304594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9da2-fe85-4e57-95c9-ebf14c1bf60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.323289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c6cf9da2-fe85-4e57-95c9-ebf14c1bf60a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:10.324799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c6cf9da2-fe85-4e57-95c9-ebf14c1bf60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:10.418052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:10.518805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa4807-8673-474a-b06a-33d303c88ec1 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.519426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa4807-8673-474a-b06a-33d303c88ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.519922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa4807-8673-474a-b06a-33d303c88ec1 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.521457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 33/64] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:10.538295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074936fa-a177-4846-807a-e1e5bc3e5cf5 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.538685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074936fa-a177-4846-807a-e1e5bc3e5cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.538834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074936fa-a177-4846-807a-e1e5bc3e5cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.566868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-074936fa-a177-4846-807a-e1e5bc3e5cf5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:10.567984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-074936fa-a177-4846-807a-e1e5bc3e5cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:10.627477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27111-cddc-4c17-8795-582baae1b2ab None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.628096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27111-cddc-4c17-8795-582baae1b2ab None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.628568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b27111-cddc-4c17-8795-582baae1b2ab None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.630131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 34/65] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:10.636126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.636660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.637133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.667344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:10.669535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 32/66] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:10.671279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:10.794140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:10.823749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aba6c-e99d-48fe-8b99-1c945fab4732 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.824017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aba6c-e99d-48fe-8b99-1c945fab4732 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.824267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aba6c-e99d-48fe-8b99-1c945fab4732 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.825760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 33/68] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:10.826601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:10.830985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0555c8-e7b6-459c-a9f1-5cdd144dad98 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.831269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0555c8-e7b6-459c-a9f1-5cdd144dad98 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.831544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0555c8-e7b6-459c-a9f1-5cdd144dad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.857323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-da0555c8-e7b6-459c-a9f1-5cdd144dad98 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:10.864338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-da0555c8-e7b6-459c-a9f1-5cdd144dad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:10.914681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:10.940446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:10.941795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a8ea-1fa6-46dd-a37c-5ac4e19ac9c6 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:10.942088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a8ea-1fa6-46dd-a37c-5ac4e19ac9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:10.942363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610a8ea-1fa6-46dd-a37c-5ac4e19ac9c6 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:10.943688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 35/70] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:10.948745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed8a2a-69da-44f0-9075-10d9f68018a6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:10.949397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a8ea-1fa6-46dd-a37c-5ac4e19ac9c6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:10.976406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.000288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.001225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.001641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.002070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.015644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-3f494a44-1c98-4a00-bedc-6c35c79a295c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:11.023344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:11.024412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:11.025495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:11.028026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:11.029299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.029757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.030163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.050364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:11.052156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:11.081608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610a8ea-1fa6-46dd-a37c-5ac4e19ac9c6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.126707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.127744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.128137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.128549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.129640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 37/72] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:11.130807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.141702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:11.146804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:11.147632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:11.148396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:11.149043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.194759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.246976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc48c36-4689-48d8-ad78-45e9e019934b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.256045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f84f7a-2fa5-4e62-9343-b1b1b1242356 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.256955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.286596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.287321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.287637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.287932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.288671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:11.288913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.290908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.292941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.293698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.294004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.294266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.300517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.302490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.311505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:11.316774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:11.317620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:11.322195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.413288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddf709-7b61-42e0-aef1-db4401700318 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.422336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.425714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac94a1-882d-4908-bfe3-6d0c723caf8d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.446698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.447301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.447578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.447848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.448500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:11.448803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.450207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.459153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.459974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.464732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.465363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.465643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.465943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.467092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.468547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.470146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 38/77] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.470903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.495503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.563341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891043a-0ff4-439f-860b-374023b7e76e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.568590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c1d5e-bf98-42a7-8fa4-662e7a0cd817 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.597750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.598464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.598746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.599021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.601691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.602848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.603126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.603396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.604042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:11.604340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.605710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.613891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 39/78] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.614735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.615136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.616533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.619659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 40/79] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.620398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.646756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.713169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.720397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257e1-6ef3-4093-b6d9-f2a45abeee57 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.723076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd83839-de58-4ad1-8d3f-284e8779132d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.753117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.753756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.754043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.754312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.755759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.756389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.756673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.756955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.758151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.759608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.761180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.761949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.764440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:11.769641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:11.770673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:11.771806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:11.775545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.862075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb25f-9fce-460d-a7ef-631554e2d7a5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.864465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:11.875032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b820e4-dbe0-4406-ae10-c1379a7863fc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:11.895891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.896499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.896786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.897059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.897707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.899702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.908325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:11.908945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:11.909229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:11.909506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:11.910672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:11.912122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:11.913900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:11.915353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.928273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 42/83] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:11 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:11.929324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:11.957021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.034019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57535b72-913c-48f9-9acd-9bb751a711d7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.064377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc1bff-2b60-4fb3-92aa-648a973472a0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.073328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.073996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.074280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.074553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.104064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.104686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.104974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.105254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.106728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.160103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.161562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.185778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.186060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.202519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.288307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:12.292627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.315189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:12.316790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.374547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.398095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef79c10-73d2-4c0f-ac43-eaafddba6ce3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.433356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.434020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.434302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.434573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.435295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:12.435600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.436992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.445292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:12.450655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.460398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f73d1-785a-4efc-b918-9eedaf431eef None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.479900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.506795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.508704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.509268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.509717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.553662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414ad0e-6044-4c71-8e59-56d4ba155294 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.588009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.588759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.589107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.589448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.590748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.592286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.599024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:12.599024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.599024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.606654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.608134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.717889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 44/88] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:12.718987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.737459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491808b-359f-4eea-a1da-1c4bd8d2f6a3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.742092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.786434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.787313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.787948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.788668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.790800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.792425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.794927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:12.795857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.836044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b2d6-11ee-4f94-be6a-50ab333d0824 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.871836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.874149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.874792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.875076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.875345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.876561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.878503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.884976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 45/90] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:12.884976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:12.933522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113b1d5-7020-43b1-ab80-61d9edff19b4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:12.980433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:12.981403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:12.982178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:12.982601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:12.983726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:12.984184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:12.985667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:12.986924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:12.994252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 46/91] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=85c18124c6384ec5be995afe6ae23067 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:12.995667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:13.009610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6ae9a-2142-40aa-8c02-3861130a3b36 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.084818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.085466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.085758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.086128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.089958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.091452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.093373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 46/92] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:13.093999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:13.182058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc856c-c3b9-4362-8701-84c9793bc289 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.203998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:13.220129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.220743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.221023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.221291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.222835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=3fd5e886cff94b13acb51e443452da3f) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:13.223151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.225695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.230520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 47/93] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:12 2022] GET /identity/v3/role_assignments?user.id=3fd5e886cff94b13acb51e443452da3f&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:13.231315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:13.291842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ddffe-c4b4-4358-8357-ebc1ba0aaa64 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.330655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.332297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.333849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.335173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.378475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:13.447139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.449040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.454257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab142d-d1b9-4c0f-bc11-a4364859a5a3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.508906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.509546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.509951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.510231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.510979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:13.511498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.512803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.528074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:13 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:13.562011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 47/95] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:13.569762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:13.654163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:13.722654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1c22-fb77-466c-b1b9-58a800d79a9e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.757951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.758585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.758866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.759141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] PATH_INFO: `/v3/projects/1e7b53950352482993a20009edf383e5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.760307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] RBAC: Authorizing `identity:get_project(project_id=1e7b53950352482993a20009edf383e5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.761805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b69df4-e0f7-46e0-9260-6da892949f32 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.763500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:13 2022] GET /identity/v3/projects/1e7b53950352482993a20009edf383e5 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:13.769616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:13.835465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:13.899482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673c9cd-341b-40ff-a612-b30834751981 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:13.937652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:13.938211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:13.938488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:13.938758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:13.939485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=1e7b53950352482993a20009edf383e5, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:13.939791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:13.941232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1e594-8eb3-4593-a0e2-f6ca116ce9f5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:13.950086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:13 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=1e7b53950352482993a20009edf383e5&role.id=85c18124c6384ec5be995afe6ae23067 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:14.678170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca1036-5e64-4f95-8dc0-165b1cf1719b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:14.678722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca1036-5e64-4f95-8dc0-165b1cf1719b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:14.678722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca1036-5e64-4f95-8dc0-165b1cf1719b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:14.680878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:14.687309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:14.688078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:14.688601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:14.714551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:14.716060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:14.756767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d085e2-40c0-43fc-92d3-9a4d739ddd24 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:14.757065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d085e2-40c0-43fc-92d3-9a4d739ddd24 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:14.757330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d085e2-40c0-43fc-92d3-9a4d739ddd24 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:14.759299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 51/99] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:14.779426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:14.779709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:14.779992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:14.803608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:14.826736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:14.827935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:14.901560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 12 15:23:15.128083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.187770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:15.251596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ace313-f4b2-4931-94ee-1c47f4ae5a91 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:15.301705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:15.302718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:15.303190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:15.303652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:15.318467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:15.324072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:15.324891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:15.325643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:15.327836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 50/102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:15.334005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.394708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:15.442874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.467152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe3f39-0677-4986-b618-27e4d986608c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:15.525684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:15.526323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:15.526603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:15.526872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:15.527536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:15.527837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:15.529219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:15.537382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 53/103] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:15.548979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.626452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a9ae0-ca61-4d9a-bfa3-e1e904657853 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:15.632350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:15.707023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:15.708523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:15.708945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:15.709355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:15.710641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:15.712776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:15.714993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 51/104] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:15.720842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.752349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534528b-11eb-4741-9103-e24460feb0a1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:15.768207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:15.816289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:15.817026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:15.817379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:15.818120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] PATH_INFO: `/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:15.845287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] RBAC: Authorizing `identity:get_user(user_id=ad7ebe09a6d04d048179a3cb3e688ee5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:15.847575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:15.849667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:15 2022] GET /identity/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5 => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:15.856084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:15.913531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808463a7-7c7c-4442-84bb-930efb2c6937 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:15.988678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:15.989634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:15.990137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:15.990641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:15.991877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:15.993553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:16.045486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93525-362f-476f-b5df-e4eb87729c50 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:16.047282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 52/106] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:23:15 2022] POST /identity/v3/projects => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:23:16.096957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:16.097594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.097897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.098169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.145163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:16.197501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:16.199022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d5b73-3d94-47b7-8cac-ab43a65fda20 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:16.334934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 55/107] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:16.341017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:16.372401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e541d-fc9a-4a9a-bc2c-eb916810eee1 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.372689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e541d-fc9a-4a9a-bc2c-eb916810eee1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.372970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e541d-fc9a-4a9a-bc2c-eb916810eee1 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.374543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 56/108] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:16.381310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bb53-e6d2-4071-aa2f-d40bef6e26f2 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.381595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bb53-e6d2-4071-aa2f-d40bef6e26f2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.381915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bb53-e6d2-4071-aa2f-d40bef6e26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.394019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:16.422937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0175bb53-e6d2-4071-aa2f-d40bef6e26f2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:16.424165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0175bb53-e6d2-4071-aa2f-d40bef6e26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:16.502101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:16.515560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 57/109] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:16.534725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2870c-dfa7-45d2-9e9d-dc61829ce309 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:16.573662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c696e-4612-4709-9073-ca082e6d1347 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.574315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c696e-4612-4709-9073-ca082e6d1347 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.574832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c696e-4612-4709-9073-ca082e6d1347 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.576539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 58/110] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:16.580601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:16.581246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.581555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.581856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.584796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:16.585660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d82b-962b-43e1-ade5-29eb4d91c31c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.586815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d82b-962b-43e1-ade5-29eb4d91c31c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.586916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:16.587429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4d82b-962b-43e1-ade5-29eb4d91c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.588842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 53/111] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:16 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:16.595207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:16.615317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2bd4d82b-962b-43e1-ade5-29eb4d91c31c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:16.616846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2bd4d82b-962b-43e1-ade5-29eb4d91c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:16.701917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:16.713535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3f1c-f00b-49a1-a744-434e570baab3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:16.725393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 59/112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:16.755449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:16.756427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.756923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.757400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.758976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=ad7ebe09a6d04d048179a3cb3e688ee5) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:16.759481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:16.761174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0eb8f-553c-4621-93d2-9a65fe03b56b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:16.767157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 54/113] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:16 2022] GET /identity/v3/role_assignments?user.id=ad7ebe09a6d04d048179a3cb3e688ee5&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=87935908dadb473b8504977ccaa8dee5 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:16.853396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045207f-af5f-4958-a394-60132b8f5eb6 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.854355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045207f-af5f-4958-a394-60132b8f5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.854843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045207f-af5f-4958-a394-60132b8f5eb6 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.856482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 60/114] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:16.862472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:16.863064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:16.863533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:16.891701 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:16.893258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:16.934416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045207f-af5f-4958-a394-60132b8f5eb6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.002497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 55/115] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:17.101403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045207f-af5f-4958-a394-60132b8f5eb6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.129303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.143717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.144355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.144633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.144903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.152426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.174368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:17.190369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:17.191260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:17.192005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 61/116] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:17.197858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.304111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.337105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e9d53-7e21-4a7e-a0b0-c9a6c9a0e7a3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.395389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bd2f-1efe-4dfa-8386-108e70775bf6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.397988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.399254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.399574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.400100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.410460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:17.415431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:17.416252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:17.416996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 56/117] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:17.418174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.455275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.455883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.456161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.456471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.457141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:17.457442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:17.460061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:17.474847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 62/118] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:17.482969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.551677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.570795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b87b1-377a-4d7e-adb2-917d62fea5b2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.606622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.607255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.607536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.607809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.618871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:17.620650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522b65b-4947-4f8f-9aeb-f3fb8da72514 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:17.623903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:17.624752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:17.625511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 57/119] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:17.626154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.636654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.662831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.663740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.664193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.664707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.665596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:17.666128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:17.667684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7905-c914-4b27-ab0c-bcb9afe5ab5b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:17.676602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 63/120] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:17.678200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42a8cc-a918-41af-bb66-837f853fde36 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.678681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42a8cc-a918-41af-bb66-837f853fde36 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.679168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42a8cc-a918-41af-bb66-837f853fde36 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.687030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 64/121] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:17.688134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42a8cc-a918-41af-bb66-837f853fde36 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.735045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8d61-5d81-42fe-912c-70088cd5c94f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.773878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.774586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.775121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.775445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.776590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:17.778127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:17.779825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 58/122] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:17.785044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.807213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42a8cc-a918-41af-bb66-837f853fde36 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.818822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.846336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.847395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.847909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.848497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.849444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:17.849986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:17.851632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedc8ae-e66e-498d-af0b-d089b6c5fe6f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:17.861211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 65/123] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:17.863187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.863684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.864135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:17.865258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.885686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:17.887248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:17.891728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7d2e7-40f9-4d8d-91c2-40247d5464b5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:17.927717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:17.928272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:17.928594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:17.928868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:17.930116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:17.931621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:17.933246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 59/124] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:17.934149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:17.962814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 66/125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:17.964061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.039552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6dd3e-7671-4efd-8c61-71dd481e37e4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.073706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9c106-dba5-424e-8d07-7b7f6da71c89 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.074567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.075202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.075480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.075753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.076374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.077101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.078967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.080502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 60/126] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:18.085422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.098677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.116528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.118088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.118557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.118998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.120458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.122168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.124142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 67/127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:17 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:18.125036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.190041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4085-3ad6-4ddc-bab6-de6889a8bcbd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.223652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.224290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.224575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.224852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.225989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.227967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.230006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 61/128] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:18 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:18.230885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.235536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ef5fe-498d-40f6-b5a8-3aa9fba6c658 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.271848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.272871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.273378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.273847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/8d04519bfc714ca88b554ce264398057/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.276212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, user_id=8d04519bfc714ca88b554ce264398057, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.277948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.295582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 68/129] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:18 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/8d04519bfc714ca88b554ce264398057/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:18.296757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.366203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.379262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.424370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283fe4a-691b-461a-b4ea-fb333b443869 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.453114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abbd9-2f2e-4010-b7b4-a829aa526626 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.461986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.462394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.462673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.463159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.464458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.466093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.467919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 62/130] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:18 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:18.473788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.493653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.494615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.495037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.495451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/8d04519bfc714ca88b554ce264398057/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.498005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, user_id=8d04519bfc714ca88b554ce264398057, role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.499646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.518653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 69/131] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:18 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/8d04519bfc714ca88b554ce264398057/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:18.528298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.591373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3d0f6-2632-41a3-ac28-a7296c35c94b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.630325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.631164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.631541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.631912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/3fd5e886cff94b13acb51e443452da3f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.634905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, user_id=3fd5e886cff94b13acb51e443452da3f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.636519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.646120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.653553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f383ec-d09a-470a-9053-ea806639ae4d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.656552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 63/132] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:18 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/3fd5e886cff94b13acb51e443452da3f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:18.704775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.705353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.705637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.705961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.719061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:18.724265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:18.725204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:18.726002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 70/133] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:18.735826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:18.754735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:18.877536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a9527-7330-43ec-b437-b04ed1e87cd9 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:18.928954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:18.930199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:18.930489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:18.930754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:18.931432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:18.931733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:18.933113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:18.949354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 64/134] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:18.954975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:19.083050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5e7cd-3c21-4f1b-a354-79e9eb22ccf0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:19.129214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:19.130218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.130699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.131210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.132593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:19.134853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:19.136662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 71/135] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:18 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:19.142392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:19.249687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:19.294089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd400a-f2c9-420f-9f2b-8f15d1fd5fcd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:19.337091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:19.337748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.338032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.338306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] PATH_INFO: `/v3/projects/1e7b53950352482993a20009edf383e5` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.339486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] RBAC: Authorizing `identity:get_project(project_id=1e7b53950352482993a20009edf383e5)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:19.340938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311edc3e-9cde-4daf-9ae1-1745f07aa770 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:19.342597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 65/136] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:19 2022] GET /identity/v3/projects/1e7b53950352482993a20009edf383e5 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:19.348364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:19.390966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:19.506863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1286dc-3b15-4682-8c9f-5e91b880fa3b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:19.559472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:19.560164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.560442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.560713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] PATH_INFO: `/v3/projects/1e7b53950352482993a20009edf383e5/users/8d04519bfc714ca88b554ce264398057/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.569466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] RBAC: Authorizing `identity:create_grant(project_id=1e7b53950352482993a20009edf383e5, user_id=8d04519bfc714ca88b554ce264398057, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:19.571076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f72a69-83dc-44ba-85eb-0af1d282786e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:19.594084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 72/137] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:19 2022] PUT /identity/v3/projects/1e7b53950352482993a20009edf383e5/users/8d04519bfc714ca88b554ce264398057/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:19.653576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7512a-bd02-430d-beed-fd6e1a4bae35 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.653921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7512a-bd02-430d-beed-fd6e1a4bae35 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.654161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7512a-bd02-430d-beed-fd6e1a4bae35 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.655789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 66/138] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:19.661506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.662045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.662498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.690901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:19.692241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:19.709336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737be5a-4def-40bc-b1fb-acc70a822b17 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.709969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737be5a-4def-40bc-b1fb-acc70a822b17 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.710728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737be5a-4def-40bc-b1fb-acc70a822b17 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.712699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 67/139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:19.724259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:19.724895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:19.725360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:19.760475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:19.762908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:19.836109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 73/140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:19.860766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 68/141] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:20.229780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.241063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:20.350949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f2d09-eea6-461e-8018-718b72495090 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:20.373686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.401451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:20.402124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:20.402401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:20.402670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:20.422532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:20.428279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:20.429162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:20.430554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 74/142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:20.443272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.513703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:20.579808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964b632-01bc-4dea-94b5-6e1100fd1567 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:20.580337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:20.643881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de13d88-01cc-4946-81ca-691297460709 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:20.659339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:20.659991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:20.660271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:20.660549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:20.661673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:20.663209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:20.672911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 69/143] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:20.673814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.693386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:20.693386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:20.693386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:20.693386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:20.693901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:20.693901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:20.693901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:20.705403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 75/144] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:20.712620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.853385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67a71e-ac68-4ceb-a233-12fe67c43200 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:20.868681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c29075-e2e4-418e-ad18-2ef0609cecb0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:20.905692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:20.909246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:20.910024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:20.910230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:20.915055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] PATH_INFO: `/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:20.918679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] RBAC: Authorizing `identity:get_user(user_id=ad7ebe09a6d04d048179a3cb3e688ee5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:20.920415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:20.922077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 76/145] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:20 2022] GET /identity/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:20.928917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:20.940963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:20.941571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:20.941878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:20.942150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:20.942810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:20.944247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:20.961531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:20.995635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 70/146] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:20 2022] POST /identity/v3/users => generated 283 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:21.097504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7920b-0a51-4c44-8f49-fd5e4a721908 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:21.146620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:21.147204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:21.147485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:21.147759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:21.149512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:21.152230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36072-f16f-4d18-bb9f-f6d974b27af3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:21.154237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 77/147] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:20 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:21.160132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:21.299564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0755-9262-4bde-99c1-f6976b116db9 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:21.334149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:21.334818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:21.335141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:21.335411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/ad7ebe09a6d04d048179a3cb3e688ee5/roles/87935908dadb473b8504977ccaa8dee5` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:21.337920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, user_id=ad7ebe09a6d04d048179a3cb3e688ee5, role_id=87935908dadb473b8504977ccaa8dee5)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:21.339415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9a826-8950-40c7-8cff-3433d9868827 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:21.359525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 71/148] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:21 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/users/ad7ebe09a6d04d048179a3cb3e688ee5/roles/87935908dadb473b8504977ccaa8dee5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:21.503181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ba0-f6b4-412d-94ca-e365f1d097a5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:21.503731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ba0-f6b4-412d-94ca-e365f1d097a5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:21.503731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea534ba0-f6b4-412d-94ca-e365f1d097a5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:21.505398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 78/149] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:21.511228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4771e-aafe-4d42-80a6-197b5d37f2ea None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:21.511698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4771e-aafe-4d42-80a6-197b5d37f2ea None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:21.512075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4771e-aafe-4d42-80a6-197b5d37f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:21.535555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-96e4771e-aafe-4d42-80a6-197b5d37f2ea None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:21.536935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-96e4771e-aafe-4d42-80a6-197b5d37f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:21.595458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:21.621389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 72/150] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:22.022531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea534ba0-f6b4-412d-94ca-e365f1d097a5 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:22.110221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:22.152736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea534ba0-f6b4-412d-94ca-e365f1d097a5 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:22.192251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:22.192956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.193236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.193506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.206169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:22.209963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0fd4-a92e-4c18-a545-d7b83e2a90a5 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.210410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0fd4-a92e-4c18-a545-d7b83e2a90a5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.210489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a0fd4-a92e-4c18-a545-d7b83e2a90a5 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.211873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 73/151] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:22.215427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:22.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:22.217830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:22.218425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3a751-d46d-4481-b52a-9c93d58d7488 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.218425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3a751-d46d-4481-b52a-9c93d58d7488 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.218425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3a751-d46d-4481-b52a-9c93d58d7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.221877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 79/152] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:22.222817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:22.244247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a0c3a751-d46d-4481-b52a-9c93d58d7488 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:22.245447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a0c3a751-d46d-4481-b52a-9c93d58d7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:22.354205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 74/153] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:22.384535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560929d-5afd-4399-929c-d400a43255c9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:22.414594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48f372-a414-405a-87ab-8aeea264a322 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.414909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48f372-a414-405a-87ab-8aeea264a322 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.415148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48f372-a414-405a-87ab-8aeea264a322 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.416943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 75/154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:22.430284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.430612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.430891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.431109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:22.451031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:22.452000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.452492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.452953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.453842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:22.454350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:22.455911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:22.463597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:22.468734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:22.474542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:22.480246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:22.573416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 76/156] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:22.690890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccd78b-d54d-484b-acab-57d7233cb5c1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:22.743330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:22.754014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:22.754660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.754937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.755207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:22.758779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:22.760372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:22.761903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 81/157] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:22 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:22.767784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:22.814947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:22.847254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:22.928307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241966e-a895-4e33-8be5-525a78918d02 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:22.933091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bf35d-5621-4a42-a31f-4b7e2b96263c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:22.998102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:22.998754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:22.999036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:22.999310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.000377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.000983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.001257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.001524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.023789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:23.028963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:23.029949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:23.031150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 77/158] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:23.044427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.157784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:23.159278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba7807-2ccc-45a1-abc0-836d1108253b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:23.241495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:23.246834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd87a07-24f5-443f-a39e-cddfabafd642 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:23.294178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:23.324459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.329870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.330395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.330858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.331722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:23.332226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:23.333811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:23.355678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 78/159] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:23.361444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.397862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 82/160] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 15:23:23.400953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6e21-1b97-494a-a576-9c1791c54ea8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.401502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6e21-1b97-494a-a576-9c1791c54ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.402011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6e21-1b97-494a-a576-9c1791c54ea8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.407374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 83/161] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:23.408594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6e21-1b97-494a-a576-9c1791c54ea8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.554973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bec54c-8b62-440e-b65b-e2b52178c71d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:23.577024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6e21-1b97-494a-a576-9c1791c54ea8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:23.603363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.604002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.604277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.604545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.625119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:23.639966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:23.640871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:23.641679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:23.642900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 79/162] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:23.643539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.646293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.646924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.647195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.647460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] PATH_INFO: `/v3/users/3fd5e886cff94b13acb51e443452da3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.650817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] RBAC: Authorizing `identity:get_user(user_id=3fd5e886cff94b13acb51e443452da3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:23.652271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c874a05-96c1-4e32-ac8d-b244128bb59a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:23.654918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 84/163] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/users/3fd5e886cff94b13acb51e443452da3f => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:23.659484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.659765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.660030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.702508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:23.706369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:23.707410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:23.738486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:23.816727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 85/164] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:23.817508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.856477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ea42a-b481-4d14-ab98-51f406b4a4a7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:23.935902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.937235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.937789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.938258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.939129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07da1f-d903-4b2b-ae21-fd9e57fba09d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:23.939941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:23.941845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:23.943852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 80/165] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:23.948208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:23.975562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:23.976313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:23.976587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:23.976853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:23.980397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:23.980397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:23.980397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:23.987928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 86/166] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:23.988768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.008456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.088637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.091289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281158-851d-4290-b94e-f3b75a8be93a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:24.104415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bc3c3-b7a7-441d-9e5f-3241e961280c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:24.126964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:24.127585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:24.127861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:24.128127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:24.128844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:24.129148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:24.130612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:24.136802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 87/167] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=85c18124c6384ec5be995afe6ae23067 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:24.137617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.168030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:24.169043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:24.169577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:24.170179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:24.230814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.256486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e1cc-5cfe-481c-b2a6-9fe7afc13bc9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:24.314678 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:24.315347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:24.315627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:24.315902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:24.318604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:24.320218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:24.321972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 88/168] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:24 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:24.327850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.359081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:24.360505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:24.503733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d7266-098c-4194-859e-e2c12a1af81f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:24.516553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.541553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 81/169] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:24.542469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.576828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:24.577447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:24.577740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:24.578035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:24.599467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.675422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:24.676954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:24.747645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c7ddd-fb92-4ad4-9afe-d9ad9f1423c0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:24.813692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:24.814341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:24.814624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:24.815160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:24.832514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 89/170] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:24.833184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.839634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:24.850422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:24.851407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:24.852276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 82/171] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:24.853954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:24.954234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:24.981434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:25.072697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b4a10-bfa5-41ba-9725-c1a227d31709 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.107843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd94a3-3d69-4472-81e4-0bae54e5ed04 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.118079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.118713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.118991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.119261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.120403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.121874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.123810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 90/172] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:24 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.124587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:25.164021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.164656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.164927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.165199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.167261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.168727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.170689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 83/173] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:24 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.171469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:25.331370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8551-9179-4d57-88ad-be757b60a89a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.358475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:25.385950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367fcb6-cd81-481d-8691-353d1ee1d75e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.406641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.407713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.408219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.408747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.409635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:25.410164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.411749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.420034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:25.428188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 91/174] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.430067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:25.470487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.471108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.471386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.471654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.472386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=3fd5e886cff94b13acb51e443452da3f) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:25.472699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.474184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.492719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 84/175] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:25 2022] GET /identity/v3/role_assignments?user.id=3fd5e886cff94b13acb51e443452da3f&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.493574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:25.590733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76a311-dcbd-46fb-8ecc-4156deb6bc60 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.668932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.669586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.669894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.670170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.670918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:25.671232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.672718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf592da-3113-4f11-b5d4-17e494bb4237 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.693456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 92/176] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:25 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.693456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6296-aa2c-4b38-acc3-462986bfbef8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.693456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6296-aa2c-4b38-acc3-462986bfbef8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.693811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6296-aa2c-4b38-acc3-462986bfbef8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.697761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 93/177] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:25.697761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476bd22-8ff2-48ce-84f8-7809fcfefee5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.697761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476bd22-8ff2-48ce-84f8-7809fcfefee5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.697761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476bd22-8ff2-48ce-84f8-7809fcfefee5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.704429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 94/178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:25.704429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.704429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.704748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.707339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fee2-c89c-4fc8-999b-987a3dd379e3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:25.738045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:25.741206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:25.787732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:25.789496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.790318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.794618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] PATH_INFO: `/v3/users/8d04519bfc714ca88b554ce264398057` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.796511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d04519bfc714ca88b554ce264398057)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:25.798442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdb3b9-dd64-4839-876a-0a61cb1f60d1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:25.805890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 85/179] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:25 2022] GET /identity/v3/users/8d04519bfc714ca88b554ce264398057 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:25.807735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298774ec-e445-4c85-b069-61277a128ca5 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.809231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298774ec-e445-4c85-b069-61277a128ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.810050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298774ec-e445-4c85-b069-61277a128ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.838131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:25.852614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-298774ec-e445-4c85-b069-61277a128ca5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:25.854171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-298774ec-e445-4c85-b069-61277a128ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:25.903672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 95/180] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:25.904568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:25.953747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:25.990609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 86/181] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:25.992874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de54e5-7e2a-4988-95be-3e5e10ed8eb2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:25.993380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de54e5-7e2a-4988-95be-3e5e10ed8eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:25.993872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de54e5-7e2a-4988-95be-3e5e10ed8eb2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:25.995867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 87/182] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:26.001854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d9572-ec6b-4e46-b244-6e5466c10cbf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.002491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d9572-ec6b-4e46-b244-6e5466c10cbf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.002960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d9572-ec6b-4e46-b244-6e5466c10cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.027354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-572d9572-ec6b-4e46-b244-6e5466c10cbf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:26.028918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-572d9572-ec6b-4e46-b244-6e5466c10cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:26.119776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 88/183] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:26.120666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92d2e4-06ab-45b1-8680-6d3dd944e83d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.157122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea269d6-ed1a-4dc0-b637-7fd292596e73 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.157426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea269d6-ed1a-4dc0-b637-7fd292596e73 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.157684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea269d6-ed1a-4dc0-b637-7fd292596e73 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.159605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 89/184] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:26.165600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.166169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.166645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.181876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.182499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.182776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.183046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.187664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:26.189073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:26.260183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.266583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 90/185] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:26.311780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:26.313236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:26.364765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.434915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.459781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 96/186] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:26.462293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.506308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ca083-eca3-4f78-97ef-15376ede8137 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.542039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.545189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.546002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.546287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.546556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.559423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:26.564305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:26.565348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 91/187] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:26.571346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.582576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23104c07-c8a9-4f40-a6f0-03ad33d6c5f4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.614937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.615556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.615831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.616098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.626422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:26.631120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:26.632005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 97/188] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:26.633889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.665115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.668354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d32761-4b0f-4a28-9b03-e5456565f72e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.703921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.704545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.704817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.705092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.714800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:26.719487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:26.720534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:26.721327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 92/189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:26.725937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.734833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c669d-7ebc-4f34-86df-de79f27f86d4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.763892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.769312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.769968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.770246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.770517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] PATH_INFO: `/v3/projects/1e7b53950352482993a20009edf383e5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.771644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] RBAC: Authorizing `identity:get_project(project_id=1e7b53950352482993a20009edf383e5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:26.773089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:26.774989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 98/190] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/projects/1e7b53950352482993a20009edf383e5 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:26.775760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.826591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8728b2d-c97c-45f8-83fe-9e8ef920ab00 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.860353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.860972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.861248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.861515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.862651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:26.864101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:26.865826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 93/191] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:26.866423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.881271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df498b-c40c-42f8-ae50-449967d2d410 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.895196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:26.916217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:26.916812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:26.917083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:26.917345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:26.918025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:26.918324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:26.919673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:26.927460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 99/192] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:26.930701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:26.965625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43940ddc-055b-43cc-be50-1d76bc11b45b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:26.989333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.000090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.000693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.000972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.001243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.001946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:27.002251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.003606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.011610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 94/193] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.016254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.029593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686e188-552a-4853-a26f-9af994fdfae5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.061845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.062626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.062906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.063170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.063846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:27.064144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.065522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.073871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 100/194] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.074613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.107941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.118205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd587-390f-48f6-8c84-e2faa01bfce1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.158129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.158729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.159003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.159267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.159979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=1e7b53950352482993a20009edf383e5, user.id=8d04519bfc714ca88b554ce264398057) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:27.160283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.161712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.167344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 95/195] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/role_assignments?user.id=8d04519bfc714ca88b554ce264398057&scope.project.id=1e7b53950352482993a20009edf383e5&role.id=85c18124c6384ec5be995afe6ae23067 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.168122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.191794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8f96-8070-42eb-bca6-b6c894ca8ce5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.219274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.231353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.231983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.232257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.232527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.233193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.234691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.273763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 101/196] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:27 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:27.273763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.303054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f923-7104-4af9-af6d-ebfe34bfff04 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.359222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.359874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.360151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.360423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.378297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.379983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.381987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 96/197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.383464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.400084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf9d5d-638c-465b-b68b-323a109d20ec None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.403651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.452497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.453577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.454261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.455548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.456945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.458585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.464697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 102/198] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.464697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.526631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.530740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495304a-ce07-4199-8f3c-f0324b2a4712 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.576131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.577011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.577284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.577552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] PATH_INFO: `/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.578721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] RBAC: Authorizing `identity:get_user(user_id=ad7ebe09a6d04d048179a3cb3e688ee5)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.580179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.581932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 97/199] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/users/ad7ebe09a6d04d048179a3cb3e688ee5 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:27.582754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.589981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1da85-1f70-4959-9c01-6e8987a0f79b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.633895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.635202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.635479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.635744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.682405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.715459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f502-3e70-43c6-8e21-7ed1fe76435a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.720217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.721825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.760112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:27.761148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:27.761629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:27.762128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:27.782737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.852821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 103/200] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:27.853995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:27.854457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:27.856257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:27.950864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:27.970050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677276e-2502-4711-b09d-e750e0cc85cb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:27.973785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 98/201] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:27.974706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.012540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.013490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.013998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.014466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.039456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:28.087227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc598c-8a0c-4c5c-ae4f-d37a76d858b4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.099944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.102566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.127503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.128570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.128856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.129133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.130313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.132127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.134306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 99/202] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:28.135527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.211090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:28.222927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 104/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:28.223778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.276382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ac18-29a0-4c8c-9b4d-804e5ffb29fa None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.286400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:28.319698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.320288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.321076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.321364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.322595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.324956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.327240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:28 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:28.328732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.356436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8c86-738e-4be6-b920-74d88b246523 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.395694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.396289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.396561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.396826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.397540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=96240e7820624766864b5426919286b2) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:28.398383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.400082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.405554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:28 2022] GET /identity/v3/role_assignments?user.id=96240e7820624766864b5426919286b2&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:28.406363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.465449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5bf85-32c3-4218-96d8-aa1815efeb2e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:28.509679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.510350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.511722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.512019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.513300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.514861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.516535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 101/206] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:28 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:28.523741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:28.642864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d015-ad62-4d3f-993d-a89de0d079a9 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.690690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.691247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.691531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.691803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.692833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, scope.project.id=6db0211d697342999c598ecaa06bbaa3, user.id=ad7ebe09a6d04d048179a3cb3e688ee5) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:28.693144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.695083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122aae-0ccb-4fad-a6e6-c711805923f7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:28.697490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd6b3-4cb3-46ad-924d-fa47c9940a4c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.710509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 102/207] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:28 2022] GET /identity/v3/role_assignments?user.id=ad7ebe09a6d04d048179a3cb3e688ee5&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=87935908dadb473b8504977ccaa8dee5 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:28.734982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:28.777722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:28.778377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:28.778658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:28.778930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:28.779682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=96240e7820624766864b5426919286b2) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:28.779991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:28.781505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea2299-83bb-47f7-9105-8a2a414d2f97 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:28.790445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 106/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:28 2022] GET /identity/v3/role_assignments?user.id=96240e7820624766864b5426919286b2&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 259 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:29.719760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec53be-db65-4a52-9440-6dcd22483a3c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:29.720743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec53be-db65-4a52-9440-6dcd22483a3c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:29.721210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec53be-db65-4a52-9440-6dcd22483a3c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:29.722771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 103/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:29.728696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:29.729494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:29.730039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:29.748529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:29.749993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:29.759327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0380-d890-4f8c-a0de-21c7faa08e8d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:29.759881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0380-d890-4f8c-a0de-21c7faa08e8d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:29.760384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d0380-d890-4f8c-a0de-21c7faa08e8d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:29.761818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 104/210] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:29.767299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:29.767577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:29.767845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:29.788545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:29.790815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:29.828776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 107/211] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:29.847561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:29.873892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 105/212] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:30.098670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.139816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.214659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c684b-8a5e-45c2-9ce5-891c830f0493 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.225490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:30.267827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.269101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.269800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.270400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.271338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ff420-5f25-40ff-befe-806ba608dc22 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.287773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:30.292695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:30.293548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:30.295120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 108/213] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:30.299493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.331193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.332723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.333230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.333702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.336042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:30.337701 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:30.339523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 106/214] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:30.345039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.396406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:30.421718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364605a-2c74-48f2-8acc-ddda4340cc14 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.458963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480690e-9981-481e-9ee0-31cc3e196d85 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.466016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.466704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.467050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.467390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.468123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:30.469010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:30.470499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:30.485773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 109/215] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:30.488632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.501669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.502328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.502598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.502863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.503510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:30.504937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:30.526339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:30.541775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 107/216] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:30 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:30.622700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018de94d-8d8a-4742-8fa3-a2c08bcfb225 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.661995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.662657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.662937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.663206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] PATH_INFO: `/v3/users/f4ef210b1e0843479c54e5cebeab88b5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.679743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] RBAC: Authorizing `identity:get_user(user_id=f4ef210b1e0843479c54e5cebeab88b5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:30.681236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a2692-5259-4e63-bbee-00a8ba273af8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:30.683406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 110/217] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:30 2022] GET /identity/v3/users/f4ef210b1e0843479c54e5cebeab88b5 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:30.688854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:30.805782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795ebf-169a-4cc1-9355-dff48ffc27c5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:30.808510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:30.846750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:30.847415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.847694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.847961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.856303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb737-2024-473a-a652-647779255544 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.856776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb737-2024-473a-a652-647779255544 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.856850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eb737-2024-473a-a652-647779255544 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.858432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 111/218] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:30.863192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:30.863466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:30.863733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:30.889574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:30.890811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:30.932054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:30.933301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccbccd-08b1-446c-ad1b-be9cc817c79c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:30.990323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 112/219] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:31.072328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 108/220] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:31.077994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.097527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.110255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc21e-69b9-4988-8cd0-a175c26e0518 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.110558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc21e-69b9-4988-8cd0-a175c26e0518 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.110801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc21e-69b9-4988-8cd0-a175c26e0518 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.112155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 109/221] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:31.118279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.118558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.118830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.134544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.152737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:31.153968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:31.248005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e42e1-19ad-4997-9592-6f9f006b74a5 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.290230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 110/222] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:31.303381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.304561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.304842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.305110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.306379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:31.308777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:31.311578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 113/223] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:31.317642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.333407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.434853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.463104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c5ad3-6401-4bdf-9a0f-02a2e8577319 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.509792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f6f95-dd56-4df9-9413-04dd8b0da052 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.532585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.533591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.534115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.534574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.555705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:31.561857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:31.562715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:31.563498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:31.570604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 114/224] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:31.576291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.581319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.595855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.596779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.597269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.597795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.598714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=f4ef210b1e0843479c54e5cebeab88b5) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:31.599214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:31.601476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:31.615079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 111/225] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/role_assignments?user.id=f4ef210b1e0843479c54e5cebeab88b5&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=85c18124c6384ec5be995afe6ae23067 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:31.621798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.728230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e0ccc-f37b-4982-ae75-67f3fe179ced None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.766692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.767816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.768300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.768784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.782299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:31.789015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:31.790020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:31.790804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:31.792441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88976f-8fcb-48ee-b3c2-f88579f831fe None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.793564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:31.799706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.866321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.883115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.883836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.884046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.884321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.885016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:31.885321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:31.886842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:31.899204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 115/227] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:31.904226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:31.917116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:31.923914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ccdcf-712c-446e-86cb-be873544dcf7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:31.961552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:31.962285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:31.962626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:31.962967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:31.963755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:31.964127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:31.965576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:31.973945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:31.980042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:32.041012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af3ba0-8dd7-44c3-9556-a77dbea227b4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.085746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.086698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.087156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.087547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bdf0e-ccfa-487d-8ffd-874f6ba492ec None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.087789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.089378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.091955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.094401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:32.102661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:32.120003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:32.145604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.146264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.146539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.146812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.149060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.150779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.158209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:31 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:32.160818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:32.249000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:32.296734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe564ca-5436-4ba4-bf0f-db3df9c212d2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.330964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0d03d-f4fe-41d1-a6b0-f2d7f497f206 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.350126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.350769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.351581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.351856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.353910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.355428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.357570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 115/231] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:32 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:32.363900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:32.425373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.426028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.426305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.426575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.428317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.429903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.431549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 117/232] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:32 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:32.437819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:32.453368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:32.538907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210693-5d50-4ebc-9b09-3834b7b6a8d8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.607457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.608047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.608325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.608596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/96240e7820624766864b5426919286b2/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.611565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, user_id=96240e7820624766864b5426919286b2, role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.613015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcb4c9-f6e8-4a3f-8252-0fb919f0337a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.622474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d4656-8192-40a7-b7cb-a63c04f184f6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:32.642434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 116/233] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:32 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/96240e7820624766864b5426919286b2/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:32.673557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:32.674305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:32.674589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:32.674859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/96240e7820624766864b5426919286b2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:32.679802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, user_id=96240e7820624766864b5426919286b2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:32.684500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf25c3-0fe3-4713-9cb5-2221625f8dce None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:32.720462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 118/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:32 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/96240e7820624766864b5426919286b2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:33.457040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238e1e-8485-46cc-84db-de5fbf2c8290 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:33.457590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238e1e-8485-46cc-84db-de5fbf2c8290 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:33.457590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf238e1e-8485-46cc-84db-de5fbf2c8290 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:33.459291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 117/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:33.475551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:33.476006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:33.476103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:33.483370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:33.500370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:33.501560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:33.530130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259c9-b8ec-4a6a-aa69-4fe0d396c39e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:33.530455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259c9-b8ec-4a6a-aa69-4fe0d396c39e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:33.530673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904259c9-b8ec-4a6a-aa69-4fe0d396c39e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:33.532243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 118/236] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:33.537247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:33.537529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:33.537854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:33.580340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 119/237] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:33.582742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:33.584126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:33.652677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 119/238] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:33.925963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.023835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.033550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36cfe2-1f48-405a-bfbf-f7569074b02f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.080034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:34.087559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:34.090342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.090984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.091259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.091516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.104744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:34.110165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:34.111037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:34.111828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:34.112418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 120/239] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:34.118242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.200066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd50c-240b-4a0f-b660-0bde3b545a7d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.236313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.236943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.237215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.237480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.238602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:34.240033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:34.242139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 120/240] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:34.247454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.328794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca13a1-e6a5-4282-9c89-e9997b5438d2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.368476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.369441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.369747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.370022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.370700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:34.371002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:34.372392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:34.381982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 121/241] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:34.388472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.436301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f24df-ee8a-4752-8c99-b3efb2fd4077 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.453442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:34.454794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:34.479520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.480229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.480595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.480937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.481670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:34.483203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a30f6-10ea-4689-bcc3-f90297e1d687 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:34.509148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 121/242] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:34 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:23:34.510651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2c9c-c40b-434f-9517-3526bfaec069 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.511327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2c9c-c40b-434f-9517-3526bfaec069 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.511728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2c9c-c40b-434f-9517-3526bfaec069 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.514014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 122/243] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:34.515416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477334c1-7e9b-4a26-b1ae-97a73eda832a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.520452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.520901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.521289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.544457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:34.546178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:34.555684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.556377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.556717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.556991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] PATH_INFO: `/v3/users/637048bc24b74dcd9009ce3a4f461e7a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.574288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] RBAC: Authorizing `identity:get_user(user_id=637048bc24b74dcd9009ce3a4f461e7a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:34.575850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:34.577872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 122/244] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/users/637048bc24b74dcd9009ce3a4f461e7a => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:34.583803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.622167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:34.698762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31481a-9d77-422d-82b2-63cc1dcc0547 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:34.714211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:34.736776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:34.737400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:34.737677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:34.737980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:34.813208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:34.814742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:34.926290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 123/246] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:34.934893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.950559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:34.965198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.064435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414550a2-4bc6-49a0-bcab-48a3fd700d91 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.071141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.077271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123421c-275f-41c8-9538-cb1abef5bcbf None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.106473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.106979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.107312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.107584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.119767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.120001 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:35.120886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.121379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.121887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.123372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:35.124777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:35.125647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:35.126501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 124/247] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:35.128626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.131047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 124/248] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:34 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:35.136367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.138028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.218284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.251898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0192a9b-5e84-4dc2-8b0f-48df9d57d931 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.265111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4ed6a-494d-4df4-8c7c-4e8fd79a902a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.293124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.293860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.294142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.294405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.295066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:35.295364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.296861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd0f7-a0e5-4742-a903-8197b3bebe0b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.308594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.309209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.309443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 125/249] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:35.309577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.309836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.310677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=637048bc24b74dcd9009ce3a4f461e7a) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:35.310783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce9be7-9892-4a68-88e9-1d3b58285085 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.310987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.311101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce9be7-9892-4a68-88e9-1d3b58285085 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.311286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce9be7-9892-4a68-88e9-1d3b58285085 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.312437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.312727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 126/250] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:35.318927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.320032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.320533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.323930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 125/251] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:35 2022] GET /identity/v3/role_assignments?user.id=637048bc24b74dcd9009ce3a4f461e7a&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=87935908dadb473b8504977ccaa8dee5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:35.326666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.350804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:35.352876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:35.377181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.461767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ca4fd-214c-47e2-8d2a-3a3d88c1175f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.485090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 127/252] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:35.504820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.505556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.505873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.506151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] PATH_INFO: `/v3/users/f4ef210b1e0843479c54e5cebeab88b5` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.507976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] RBAC: Authorizing `identity:get_user(user_id=f4ef210b1e0843479c54e5cebeab88b5)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.509515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d77417-2730-4f62-8d39-05c4145e742b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.511545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 126/253] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:35 2022] GET /identity/v3/users/f4ef210b1e0843479c54e5cebeab88b5 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:35.517174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.590116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.599585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf4e5-520d-4356-94e7-3227f1e64bba None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.599863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf4e5-520d-4356-94e7-3227f1e64bba None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.600132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf4e5-520d-4356-94e7-3227f1e64bba None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.602337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 127/254] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:35.612931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.613264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.613542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.634593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:35.635778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:35.652923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac34a2-b3ef-4179-a87b-90e405682626 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.722901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.723547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.723818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.724086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.726713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.728619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.730323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 128/255] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:35 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:35.736645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.766005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 128/256] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:35.878063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbdcb-5848-46d0-8f39-89ff3d9daa73 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:35.893206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:35.926101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.932462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:35.933123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:35.933402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:35.933674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/f4ef210b1e0843479c54e5cebeab88b5/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:35.937082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, user_id=f4ef210b1e0843479c54e5cebeab88b5, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:35.939186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:35.939402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:35.962854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:35 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/f4ef210b1e0843479c54e5cebeab88b5/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:23:36.045893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58282b-6d3c-4566-bab9-29b629bb51a5 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.097362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.098100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.098376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.098644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.110889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:36.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:36.117255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:36.118680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 129/258] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:36.127103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.291694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaaa13-ffc2-43f3-b3dd-5a5ad26553eb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.294111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.348311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.348846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.349125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.349395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.350095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:36.350454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:36.352086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:36.369449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:36.374630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.399561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:36.413454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91129-c5be-408f-b31e-dafca2c6427a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.457156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.457809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.458090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.458355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.458776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:36.476860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:36.482275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:36.484549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:36.486528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:36.514832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.521748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3f0d7-ef3e-4e2e-8b6b-829795e42ed7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.574467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.575118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.575397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.575671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.576864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:36.578405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:36.580302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:36.585423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.693145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee960e-fb29-4905-8206-f82c79be4739 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.723309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cee3c8-6741-41c1-bed1-3d7ee715d755 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:36.757551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:36.773237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.773933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:36.774551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.775084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.775354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.776478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:36.776756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:36.777021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:36.777684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:36.778009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:36.779423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:36.799044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 131/262] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:36.822254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:36.836941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:36.905777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:36.905777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:36.976964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7effcc-ee47-4b95-ab8c-a1f2d5de7b66 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.012527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 132/263] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:37.018705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:37.034481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.035392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.035868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.036351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] PATH_INFO: `/v3/users/96240e7820624766864b5426919286b2` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.042390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] RBAC: Authorizing `identity:get_user(user_id=96240e7820624766864b5426919286b2)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.044064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.045844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 132/264] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:36 2022] GET /identity/v3/users/96240e7820624766864b5426919286b2 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:37.054739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:37.061820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:37.167435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:37.178366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafe14b-e6e2-4647-80b5-ad66b699f2fd None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.193297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247fec3-b809-4ac8-b134-191c97795940 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.243288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.244238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.245625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.246132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.262462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.263106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.263384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.263652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.264818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.266302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.268225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 133/265] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:37 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:37.274428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:37.341397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.343259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.427283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:37.452992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 133/266] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:37.458198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:37.482114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:37.505486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cc6fd-d5ae-4c30-946f-125f34c62cb8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.579299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.579957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.580168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.580433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.581147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=96240e7820624766864b5426919286b2) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:37.581458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.582927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.597849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 134/267] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:37 2022] GET /identity/v3/role_assignments?user.id=96240e7820624766864b5426919286b2&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:37.640105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556934-6aa8-4b0e-a466-302fa428379a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.721491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.722545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.723027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.723499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.730606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.732416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46111c62-d807-4a3e-a8bd-b574528f5ec4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.734404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 134/268] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:37 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:37.740684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:37.881350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8505b-d805-4087-b58e-2e724192fd2a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:37.921886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:37.922490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.922766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.923036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.923751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=96240e7820624766864b5426919286b2) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:37.924052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:37.925474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c27c-158b-4e77-a3f8-1769d577a29a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:37.931869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 135/269] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:37 2022] GET /identity/v3/role_assignments?user.id=96240e7820624766864b5426919286b2&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:37.983957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2e57-b59c-4659-8875-55527f2b401d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.984553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2e57-b59c-4659-8875-55527f2b401d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.984828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb2e57-b59c-4659-8875-55527f2b401d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:37.986694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 135/270] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:37.992945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:37.993242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:37.993489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.019303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:38.020509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:38.039239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:38.102828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 136/271] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:38.469356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2e57-b59c-4659-8875-55527f2b401d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:38.521959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:38.594743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb2e57-b59c-4659-8875-55527f2b401d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:38.642236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:38.642854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.645751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.645751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.664016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-93ffbe6c-5ce9-4fa4-bde8-954f910a9d25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:38.668999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:38.669890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:38.670695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:38.671764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 136/272] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:38.677707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:38.733993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca5a-4200-4d21-914d-8c1259908751 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.734342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca5a-4200-4d21-914d-8c1259908751 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.734829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6ca5a-4200-4d21-914d-8c1259908751 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.736663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 137/273] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:38.741942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e52f-d997-4717-9c3a-d0263fa48a6b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.742220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e52f-d997-4717-9c3a-d0263fa48a6b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.742489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171e52f-d997-4717-9c3a-d0263fa48a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.761475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8171e52f-d997-4717-9c3a-d0263fa48a6b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:38.762952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8171e52f-d997-4717-9c3a-d0263fa48a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:38.835841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 138/274] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:38.837465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400e2f-c640-4bea-b0e6-a74561a71d7b None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.837764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400e2f-c640-4bea-b0e6-a74561a71d7b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.838183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e400e2f-c640-4bea-b0e6-a74561a71d7b None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.839485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 139/275] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:38.844652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.844972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.845241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.866931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570770c1-d5db-49c3-b150-77fe93b9554a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:38.881078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:38.882312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:38.927263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:38.928245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:38.928749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:38.929211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:38.930432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:38.931604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:38.933527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:38.960581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 137/276] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:38.961652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:38.963278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:38.993063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:39.037314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 140/277] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:39.105356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06681bad-44b7-4b35-8dd5-52509b1355a7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.126136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.142194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780534-51a8-408d-b147-0579daa6989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.143176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780534-51a8-408d-b147-0579daa6989e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.143517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780534-51a8-408d-b147-0579daa6989e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.143925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780534-51a8-408d-b147-0579daa6989e None admin] PATH_INFO: `/v3/users/11e1ff564316491b9fcbc8a3c481888f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.162240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21780534-51a8-408d-b147-0579daa6989e None admin] RBAC: Authorizing `identity:get_user(user_id=11e1ff564316491b9fcbc8a3c481888f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.163967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21780534-51a8-408d-b147-0579daa6989e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.165792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 138/278] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:38 2022] GET /identity/v3/users/11e1ff564316491b9fcbc8a3c481888f => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:39.171481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780534-51a8-408d-b147-0579daa6989e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.248302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7f542-ff65-4764-92f6-4b1ad61ed08c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.251640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:39.285946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.286579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.286858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.287128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.288240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.288988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21780534-51a8-408d-b147-0579daa6989e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.289817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.295993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 141/279] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:39.297616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.328820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.329413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.329686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.329985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.330695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, user.id=11e1ff564316491b9fcbc8a3c481888f, scope.system=all) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:39.330998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.331367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:39.332513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32307bb-a621-4b74-a92b-7b771a53ed38 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.337360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 139/280] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/role_assignments?user.id=11e1ff564316491b9fcbc8a3c481888f&scope.system=all&role.id=85c18124c6384ec5be995afe6ae23067 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:39.338529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f444d5-0bc9-471a-b771-4c35f2f1c8db None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.338808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f444d5-0bc9-471a-b771-4c35f2f1c8db None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.339076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f444d5-0bc9-471a-b771-4c35f2f1c8db None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.340278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 140/281] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:39.344506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f444d5-0bc9-471a-b771-4c35f2f1c8db None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.416679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a43-646e-4719-9a90-6947f828addd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.455565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.456185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.456467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.456735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.457399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.458967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c99f-1cb7-438c-b1db-644effa20b63 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.465005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f444d5-0bc9-471a-b771-4c35f2f1c8db None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.482218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 142/282] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:23:39 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:23:39.495241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.495530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.495806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.502646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:39.509663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.510523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.511971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.511971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.527435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:39.527636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:39.529117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:39.533270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:39.534435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:39.535410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:39.541713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 141/283] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:39.542815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.621756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 143/284] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:39.669675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0282f-73c9-4d8d-a86e-18ce6d830424 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.716664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.717278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.717532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.717845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.718575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:39.718876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.720307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.729886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 142/285] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:39.735013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.756833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:39.839447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92aa0bc-1eb9-416e-a372-57b49a2444d0 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:39.876518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:39.877158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:39.877434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:39.877706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] PATH_INFO: `/v3/users/637048bc24b74dcd9009ce3a4f461e7a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:39.878864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] RBAC: Authorizing `identity:get_user(user_id=637048bc24b74dcd9009ce3a4f461e7a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:39.880417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:39.882469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 144/286] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/users/637048bc24b74dcd9009ce3a4f461e7a => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:39.887636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.910433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:39.956109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:40.014476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b67bb9-34cb-4f8c-a102-fac0572525a7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.020306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:40.038852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00796cb-bc6d-4226-a744-69922e8e73ae None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.072159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.073335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.074672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.075302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.077831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:40.079628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:40.085238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 143/287] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:40.090940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:40.122611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.123302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.123571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.123824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.146160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:40.157084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:40.158031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:40.158819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:40.159965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 145/288] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:40.165042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:40.282717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903276-5a07-4823-a6f3-3512340c2e58 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.321159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2315b-baeb-47a0-a26b-b082ba33a3b4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.321352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:40.336284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.336955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.337230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.337495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/637048bc24b74dcd9009ce3a4f461e7a/roles/87935908dadb473b8504977ccaa8dee5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.339472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, user_id=637048bc24b74dcd9009ce3a4f461e7a, role_id=87935908dadb473b8504977ccaa8dee5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:40.340954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:40.360514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 144/289] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:23:40 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/users/637048bc24b74dcd9009ce3a4f461e7a/roles/87935908dadb473b8504977ccaa8dee5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:23:40.385463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.386195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.386474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.386739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.387403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:40.387760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:40.389181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:40.401983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 146/290] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:40.407975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:40.529198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67503-6657-42c3-8318-ef77c9c4775a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.567393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.568369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.568850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.569882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] PATH_INFO: `/v3/users/f4ef210b1e0843479c54e5cebeab88b5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.571384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=f4ef210b1e0843479c54e5cebeab88b5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:40.573083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:40.575446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 145/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:40 2022] GET /identity/v3/users/f4ef210b1e0843479c54e5cebeab88b5 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:40.581466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:40.601580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:40.708145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a49e8-d89b-4cbc-b791-ec4724494014 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:40.744639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:40.745261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:40.745503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:40.745796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:40.820780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:40.822266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:40.834316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:40.930093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 147/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:40.935305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:41.008671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:41.072097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281083e-fddf-49f9-805f-f76576adc4c6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:41.106005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:41.106631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:41.106911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:41.107182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:41.108294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:41.109757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f28e6-de1e-43d2-8b2a-bc2401562374 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:41.111747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 146/293] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:40 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:41.117822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:41.248762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba682f-00c7-4880-aa7a-0caa8bd52f51 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:41.260053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:41.293206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:41.294213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:41.294684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:41.295166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:41.296109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=f4ef210b1e0843479c54e5cebeab88b5) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:41.296415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:41.297862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c37d7-e521-44aa-864e-3b7be7ad13b3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:41.306170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 148/294] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:41 2022] GET /identity/v3/role_assignments?user.id=f4ef210b1e0843479c54e5cebeab88b5&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=85c18124c6384ec5be995afe6ae23067 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:41.901990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12b64-fb10-4661-98b2-3a3fd013eacf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:41.902666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12b64-fb10-4661-98b2-3a3fd013eacf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:41.903148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12b64-fb10-4661-98b2-3a3fd013eacf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:41.904960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 147/295] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:41.910473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93898f-100d-498c-9a56-d0a2292c8b13 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:41.911356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93898f-100d-498c-9a56-d0a2292c8b13 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:41.911827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93898f-100d-498c-9a56-d0a2292c8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:41.932103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ec93898f-100d-498c-9a56-d0a2292c8b13 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:41.933593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ec93898f-100d-498c-9a56-d0a2292c8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:42.013872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 149/296] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:42.280042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058e1d-4a9e-4a0c-a47b-a60948969b96 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.280532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058e1d-4a9e-4a0c-a47b-a60948969b96 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.280532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058e1d-4a9e-4a0c-a47b-a60948969b96 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.282014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 148/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:42.287384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bd43-7018-4451-aebc-59bf5f23d619 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.287903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bd43-7018-4451-aebc-59bf5f23d619 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.288425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004bd43-7018-4451-aebc-59bf5f23d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.293039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a058e1d-4a9e-4a0c-a47b-a60948969b96 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.307641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1004bd43-7018-4451-aebc-59bf5f23d619 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:42.308825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1004bd43-7018-4451-aebc-59bf5f23d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:42.388258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 150/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:42.397932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f723f-4948-4ec1-bf05-6f45e03ea632 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.397932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f723f-4948-4ec1-bf05-6f45e03ea632 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.397932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f723f-4948-4ec1-bf05-6f45e03ea632 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.397932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 151/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:42.402899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.403195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.403473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.424421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:42.425642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:42.431259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a058e1d-4a9e-4a0c-a47b-a60948969b96 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:42.450997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:42.462903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:42.474233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:42.475420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.475894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.476368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.488256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:42.493863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:42.494719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:42.495481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:42.497975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 149/300] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:42.503495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.520906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 152/301] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:42.613419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157076-b330-45b4-8461-fed2ef993cb0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:42.648600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:42.649414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.650110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.650542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.651334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:42.651774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:42.653311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:42.662048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 150/302] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:42.672104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.675283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.720637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:42.793793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6c3f4-01a1-40c4-a95b-370f1ac2cdcd None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:42.801803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55c94-a4e9-4ee2-8cef-1091c03c23dc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:42.830579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:42.831358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.831642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.831913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.842712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:42.847413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:42.847928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:42.848777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:42.849579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:42.850379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:42.850379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:42.850379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] PATH_INFO: `/v3/users/11e1ff564316491b9fcbc8a3c481888f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:42.851100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 151/303] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:42.851100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.854190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] RBAC: Authorizing `identity:get_user(user_id=11e1ff564316491b9fcbc8a3c481888f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:42.855648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:42.857397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 153/304] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/users/11e1ff564316491b9fcbc8a3c481888f => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:42.859825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:42.891027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:42.961686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:42.965394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650c43-3aff-4c40-b220-2c2f6d062008 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:42.970529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dbd93-0562-4f10-bff3-8035f277b2fe None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.003719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.004364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.004649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.004932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.005197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.005826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.006073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.006166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.006363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.007059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:43.007362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.007552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.008705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.013899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 152/305] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:43.013899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.017298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 154/306] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:43.018126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.110322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:43.118038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800381c8-6345-4a4d-91ee-ca81fe0e261f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.120378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e1581-4dbf-4abd-9e4e-1912031c5ad7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.155283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.155838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.156109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.156374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] PATH_INFO: `/v3/system/users/11e1ff564316491b9fcbc8a3c481888f/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.157778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=11e1ff564316491b9fcbc8a3c481888f, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.159161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.163350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.164233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.164652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.164867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] PATH_INFO: `/v3/groups` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.165783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.167409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 153/307] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 12 15:23:43 2022] PUT /identity/v3/system/users/11e1ff564316491b9fcbc8a3c481888f/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:43.168073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df498ade-dd24-49cd-b244-87f8acf7617a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.168322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.202099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 155/308] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 12 15:23:43 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:43.202099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b667-1410-46f0-bf4d-76f1949d28ed None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.202099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b667-1410-46f0-bf4d-76f1949d28ed None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.202099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b667-1410-46f0-bf4d-76f1949d28ed None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.202099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 156/309] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:43.205662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.206249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.206754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.223324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:43.237577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:43.240421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:43.323284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecc6c4-efcd-421a-8ade-ac53cdb8f8f3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.343095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 157/310] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:43.377455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.378127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.378400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.378671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] PATH_INFO: `/v3/users/5597b2cc96a9464cb8da3052651727dd` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.395690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] RBAC: Authorizing `identity:get_user(user_id=5597b2cc96a9464cb8da3052651727dd)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.395877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.397856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 154/311] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:43 2022] GET /identity/v3/users/5597b2cc96a9464cb8da3052651727dd => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:43.404145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.502546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:43.520484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edaf65-e190-4ffa-905f-e8b85348ea7f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.556569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.557172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.557448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.557711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.558526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, user.id=5597b2cc96a9464cb8da3052651727dd, scope.system=all) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:43.558837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.560293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.565897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 158/312] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 15:23:43 2022] GET /identity/v3/role_assignments?user.id=5597b2cc96a9464cb8da3052651727dd&scope.system=all&role.id=87935908dadb473b8504977ccaa8dee5 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:43.632235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.744777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:43.755668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950346a-70a0-4f3c-8528-99b91874010f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.792604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.793237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.793550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.793855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.804331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:43.809257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:43.810178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:43.810972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 155/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:43.816341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:43.923087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289828-f4dc-4294-9129-cbb1843f6930 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:43.958974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:43.960475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:43.960957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:43.961429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:43.962323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:43.962829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:43.964418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:43.973669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:43.980232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:44.084517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abbede-164b-4fec-a1fb-64fbf52bf939 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:44.124169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:44.125187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:44.125670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:44.126162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] PATH_INFO: `/v3/users/637048bc24b74dcd9009ce3a4f461e7a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:44.127572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] RBAC: Authorizing `identity:get_user(user_id=637048bc24b74dcd9009ce3a4f461e7a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:44.129268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:44.131710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 156/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:43 2022] GET /identity/v3/users/637048bc24b74dcd9009ce3a4f461e7a => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:44.137485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:44.153383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:44.247040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd25971-b4bd-4c54-aea7-861e368bd5ba None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:44.282106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:44.282714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:44.283025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:44.283313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:44.353924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:44.357257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:44.369544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:44.462362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:44.467789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:44.488299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:44.575807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1530ea-96f9-42c4-8ee5-69a6e0715357 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:44.615202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:44.615746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:44.616042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:44.616314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:44.617421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:44.618929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aa7c2-5f93-4976-a179-864cb77a37e7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:44.620738 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:44 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:44.626437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:44.727992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fab0a-440d-4574-8846-5bffc529386d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:44.738774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:44.762478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:44.763082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:44.763362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:44.763630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:44.764348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, scope.project.id=a70fbcb83a80479db13599bde38c4fe7, user.id=637048bc24b74dcd9009ce3a4f461e7a) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:44.764653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:44.766138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e1c0-0db4-4c01-836d-424bfda8c263 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:44.772198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 161/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:23:44 2022] GET /identity/v3/role_assignments?user.id=637048bc24b74dcd9009ce3a4f461e7a&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=87935908dadb473b8504977ccaa8dee5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:45.436161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce92c2-3013-4f99-9eb3-077401a4da9f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.436539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce92c2-3013-4f99-9eb3-077401a4da9f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.436784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce92c2-3013-4f99-9eb3-077401a4da9f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.438206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:45.443337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.443792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.443867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.462517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:45.463686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:45.495676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fbe3-c5a3-4bb4-bb3a-e6f0034de31f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.496209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fbe3-c5a3-4bb4-bb3a-e6f0034de31f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.496209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247fbe3-c5a3-4bb4-bb3a-e6f0034de31f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.497758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 159/320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:45.502386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458049e4-40a3-43d9-ac1d-3437a8edd108 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.502667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458049e4-40a3-43d9-ac1d-3437a8edd108 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.502936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458049e4-40a3-43d9-ac1d-3437a8edd108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.521543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-458049e4-40a3-43d9-ac1d-3437a8edd108 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:45.522863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-458049e4-40a3-43d9-ac1d-3437a8edd108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:45.535547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 162/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:45.590276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:45.801711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:45.845894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed88-f08d-4111-934f-eef488b0d59c None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.846202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed88-f08d-4111-934f-eef488b0d59c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.846445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7ed88-f08d-4111-934f-eef488b0d59c None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.847821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 161/323] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:45.853253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.853545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.853842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.872611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:45.873818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:45.884398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:45.900008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e6a5-112a-493a-806b-bb07afad5183 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:45.902460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:45.933684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:45.934324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:45.934598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:45.934861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:45.939432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 162/324] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:45.940086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:45.948968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:45.954778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:45.955635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:45.956427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 163/325] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:45.962602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.044105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c915b2f-314d-40a0-b869-b837b04111ed None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.067708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c46fe2-7de4-4a38-b44e-33ad4a9846c6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.080146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.080772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.081048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.081317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.082431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.083861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.086140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 163/326] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:23:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:46.091527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.102314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.103133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.103407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.103672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.104323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:46.104618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.105995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.108436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:46.116137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 164/327] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:46.121585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.150285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:46.195265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6fb21-7411-4f33-bcf4-ae6c12eab4ff None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.224369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a20d-ae6f-4e8d-92b4-f1988f13bf57 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.228532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.229134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.229410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.229700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] PATH_INFO: `/v3/groups` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.230346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.231763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.249764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 164/328] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 12 15:23:46 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:23:46.249764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.266756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.267889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.268335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.268613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] PATH_INFO: `/v3/users/11e1ff564316491b9fcbc8a3c481888f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.269877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] RBAC: Authorizing `identity:get_user(user_id=11e1ff564316491b9fcbc8a3c481888f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.271342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.273051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 165/329] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:46 2022] GET /identity/v3/users/11e1ff564316491b9fcbc8a3c481888f => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:46.279499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.340225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:46.365290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add9d5b-4525-4a2b-96f1-653b26075dae None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.392350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:46.400165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a22a3-3b33-4501-9442-6c1344a5df13 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.405451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.406204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.406483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.406753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.418923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:46.424733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:46.425597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:46.430718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 165/330] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:46.431662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.445162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.445162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.445719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.445719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.446447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] RBAC: Adding query filter params (role.id=85c18124c6384ec5be995afe6ae23067, user.id=11e1ff564316491b9fcbc8a3c481888f, scope.system=all) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:46.446753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.448170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.462050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 166/331] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 15:23:46 2022] GET /identity/v3/role_assignments?user.id=11e1ff564316491b9fcbc8a3c481888f&scope.system=all&role.id=85c18124c6384ec5be995afe6ae23067 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:46.550509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4eb50-5626-486b-8903-3731ac63246e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.588978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.589597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.589911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.590184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.590972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:46.591247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.592617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.594298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:46.606477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 166/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:46.612614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.735332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bbd33-9fb7-4249-8683-db5724eb576c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.774229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.775178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.775400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.775667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] PATH_INFO: `/v3/users/5597b2cc96a9464cb8da3052651727dd` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.776830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] RBAC: Authorizing `identity:get_user(user_id=5597b2cc96a9464cb8da3052651727dd)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.778335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb330e-19c0-45c8-91db-938b9f709fcb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.780225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 167/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:46 2022] GET /identity/v3/users/5597b2cc96a9464cb8da3052651727dd => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:46.785858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:46.896433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904d18-f2a3-4529-b171-281edb6ecf44 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:46.935363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:46.936025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:46.936307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:46.936618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] PATH_INFO: `/v3/system/users/5597b2cc96a9464cb8da3052651727dd/roles/87935908dadb473b8504977ccaa8dee5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:46.938089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5597b2cc96a9464cb8da3052651727dd, role_id=87935908dadb473b8504977ccaa8dee5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:46.939571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e48d7-75ad-4b0b-ae5f-637ba1a92218 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:46.950609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 167/334] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 12 15:23:46 2022] PUT /identity/v3/system/users/5597b2cc96a9464cb8da3052651727dd/roles/87935908dadb473b8504977ccaa8dee5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:49.099607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec96c-c3bb-465c-bb10-e4e694080200 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:49.100153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec96c-c3bb-465c-bb10-e4e694080200 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:49.100271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec96c-c3bb-465c-bb10-e4e694080200 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:49.101937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 168/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:49.108817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:49.109250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:49.109351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:49.130801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:49.132556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:49.207230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb77c-5e85-4b71-b6e6-12a3ffb4d068 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:49.207565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb77c-5e85-4b71-b6e6-12a3ffb4d068 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:49.207778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb77c-5e85-4b71-b6e6-12a3ffb4d068 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:49.209278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 169/336] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:49.212141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:49.217349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:49.217962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:49.218455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:49.227442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 168/337] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:49.253772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:49.255317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:49.282396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:49.360849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:49.770600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:49.896398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f59f15-25a2-45b8-bd58-68d4420e27ee None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:49.930997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:49.940622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:49.941188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:49.941460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:49.941745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:49.957928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:49.963306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:49.964178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:49.964963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 169/339] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:49.970050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.083234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.148812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365f47-f9ef-461e-a6cb-13c1ac2fd59e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:50.155665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60642e-f5cf-47c8-ad47-0de611170264 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:50.197364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:50.197894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.198174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.198443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.199118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] RBAC: Adding query filter params (name=member) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:50.199420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:50.200798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f036395-c60f-4a49-9125-8e0017356d63 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:50.213718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 170/340] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:50.215547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadacc4d-65c2-4dc7-935a-71e92eeb957e None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.215832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadacc4d-65c2-4dc7-935a-71e92eeb957e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.216102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadacc4d-65c2-4dc7-935a-71e92eeb957e None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.217298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 171/341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:50.219280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:50.219911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.220181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.220443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.222015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37302631-4dae-4ab0-a72c-3178fc8fffb2 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.222288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37302631-4dae-4ab0-a72c-3178fc8fffb2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.222548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37302631-4dae-4ab0-a72c-3178fc8fffb2 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.223732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 172/342] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:50.224715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd46d3-d7d3-4a5d-8247-8619305ac223 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.224986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd46d3-d7d3-4a5d-8247-8619305ac223 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.225796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd46d3-d7d3-4a5d-8247-8619305ac223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.238817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:50.244533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:50.245410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:50.246257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 171/343] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:50.246892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.260168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-46dd46d3-d7d3-4a5d-8247-8619305ac223 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:50.261358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-46dd46d3-d7d3-4a5d-8247-8619305ac223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:50.261849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.340913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 173/344] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:50.342445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.342789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.343068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.372538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:50.373120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8546-149d-4bd7-8b0f-8589928d0ae6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:50.373864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:50.409866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:50.410478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.410757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.411026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.431315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.491889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:50.493880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:50.507335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.511290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:50.517769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.635250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 172/346] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:50.643526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.681275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de372ce8-858f-4cae-89e6-0703952c78b6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:50.743176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:50.743702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.743980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.744251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.744928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:50.745230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:50.748857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc39bbd-ddb1-477a-8672-70e3f76527e0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:50.758704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 175/347] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:50.762174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd7a-8df3-41e2-944d-ff0c52f20498 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.762174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd7a-8df3-41e2-944d-ff0c52f20498 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.762174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd7a-8df3-41e2-944d-ff0c52f20498 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.764819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 176/348] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:50.769024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.769706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.769947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.792742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd850-49ef-42a1-9603-d6f3a01db2f5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:50.793172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:50.794522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:50.806372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.835157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:50.841855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:50.843082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:50.843505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:50.843935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:50.845284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:50.847191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:50.850863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 173/349] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:50 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:50.851807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.891919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 177/350] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:50.893106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:50.991469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940cd1a-e694-49e4-a1a6-bea65b034bdf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.023463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940434e3-d59f-4d2c-b022-d86abdde7caf None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.041451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.042166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.042438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.042702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.073779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.074717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.075000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.075273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.082067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.083550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.085377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 178/351] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:50 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:51.086093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.097185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.121071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.128117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.129587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32915-3a5e-46a3-a9b6-ed2f4de824e1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.216666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b825bbc-3e47-4595-9376-0a195d2830c7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.253153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.253816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.254095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.254364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.261802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 174/352] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:51.263833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a97c4-cd5d-4992-97c2-0b9f1bf9d88b None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.264118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a97c4-cd5d-4992-97c2-0b9f1bf9d88b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.264386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a97c4-cd5d-4992-97c2-0b9f1bf9d88b None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.265403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:51.265923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 175/353] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:51.270544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a97c4-cd5d-4992-97c2-0b9f1bf9d88b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:51.271182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:51.272635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:51.273519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 179/354] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:51.274348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.380293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.382808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.395956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd4d3ed-0e88-49d8-acf9-dd8af113fc12 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.413881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a97c4-cd5d-4992-97c2-0b9f1bf9d88b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.443532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.444171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.444444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.444711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.445426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=6db0211d697342999c598ecaa06bbaa3) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:51.445820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.448238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.455343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 180/355] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=85c18124c6384ec5be995afe6ae23067 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:51.456445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.456748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.457377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.457652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.457949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.472679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:51.480371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:51.481377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:51.482232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 176/356] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:51.482901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.604875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f4c17-8534-48a9-b6f9-d27e1ea701f7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.620001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c40537-161a-4ce2-86f5-bfc3794e4522 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.652572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.653315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.653599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.653936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.668047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.668678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.668952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.669220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.670393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.670511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:51.671826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c54ac5-982f-4e70-8b1e-98f20c45c1c2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.674625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 177/357] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:51.675814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:51.675921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:51.676729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:51.677602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:51.678321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.678321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.679173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 181/358] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:51.679173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.695239 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.697654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.699659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:51.700914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:51.787243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 178/359] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:51.788353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.797419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cb02e-9c77-430f-876c-5916c6429ed5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.842287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.843162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.843627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.844075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.844900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:51.845477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.847262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.858235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 182/360] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:51.859310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:51.915637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9265e-a052-411e-a12f-b84bad821b44 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.945945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.974722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:51.974722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:51.974722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:51.974722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:51.975181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:51.975181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:51.976736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:51.977583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e3bc-18b6-416b-ac33-ddc801f74730 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:51.979405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:51.990020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 179/361] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:51.991113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.027201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.028606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.029295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.030068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.031664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:52.032437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.035273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.049506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 183/362] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:52.051252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.150739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ee9be-662c-492d-b154-c697335dd372 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.169927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf294f-f0ba-4bd5-a058-8c468907afad None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.198598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.199229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.199508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.199785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.201143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.202633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.204565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 180/363] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:51 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:52.205423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.213130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.213844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.214097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.214366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] PATH_INFO: `/v3/users/5597b2cc96a9464cb8da3052651727dd` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.215503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] RBAC: Authorizing `identity:get_user(user_id=5597b2cc96a9464cb8da3052651727dd)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.217396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.219557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 184/364] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/users/5597b2cc96a9464cb8da3052651727dd => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:52.220458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.225316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.285283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.330433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff0cb0-3041-4062-a8c2-0dd6e81d5245 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.359906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073227f-f075-41f4-b703-ad0f74a6c642 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.372797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.373572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.373900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.374175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.401754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.402318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.402596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.402870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.458129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.460012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.488644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.489370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.493037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.540495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.589426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 181/365] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:52.589640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.612721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 185/366] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:52.614149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.711159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042689cc-f88c-4282-a6fb-fd26672cda8d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.749585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.750499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.750926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.751350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.755918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c51c32-6e9c-482d-bb50-09e783ff254d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.758909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.765189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:52.771293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:52.772847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:52.773665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 182/367] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:52.774364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.801141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.801938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.802218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.802808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.804075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=6db0211d697342999c598ecaa06bbaa3) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:52.804386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.805857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.813793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:52.815135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 186/368] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:52.818358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:52.916585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d241ca-4ca5-449c-9225-8cdd34c188e8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.962353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:52.962974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:52.963249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:52.963514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:52.964268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] RBAC: Adding query filter params (role.id=87935908dadb473b8504977ccaa8dee5, user.id=5597b2cc96a9464cb8da3052651727dd, scope.system=all) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:52.964573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:52.966112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:52.970027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138ecfd-6abf-44ec-807b-a906d690368b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:52.983407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 183/369] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/role_assignments?user.id=5597b2cc96a9464cb8da3052651727dd&scope.system=all&role.id=87935908dadb473b8504977ccaa8dee5 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:52.984287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.022253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.022909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.024247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.025534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.026864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.028326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.030412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 187/370] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.031204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.081038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.151894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.173247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94bafe-8b80-40a0-8393-01e9841b88ee None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.201699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d9d94-cf71-4287-8e11-ae0435fc92e3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.221865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.223704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.223971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.224241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.227572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.229024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.235733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 184/371] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:52 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.236643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.259537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.260246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.260419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.260688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.261353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:53.261651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.267088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.280622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 188/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.281432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.380330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348dd06-26e5-474e-81b7-e6e4249033d0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.401720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.407134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefc492-4ecd-4686-9e45-9372f9f48af2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.424050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.424721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.425069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.425402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.426620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.428940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.430779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 185/373] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.433254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.458554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.459195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.459502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.459779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.460903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.462298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.462511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.464177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 189/374] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.464935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.555791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8eea-3a3a-416c-a0ce-5b3ee052b93f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.596650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.597262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.597535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.597781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e96bc-895c-427a-8bac-7036a27be9dc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.597888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.649455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.650340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.650619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.650890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.651896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=a70fbcb83a80479db13599bde38c4fe7) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:53.653077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.654555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.661471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 190/375] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=85c18124c6384ec5be995afe6ae23067 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.662546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.705773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.705773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.708388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.736334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:53.806026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929d11-5e75-4115-b434-0445f099009f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:53.855352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 186/376] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:23:53.860628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:53.877226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:53.877863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.878141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.878408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.879138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=a70fbcb83a80479db13599bde38c4fe7) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:53.879441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:53.880922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bcd9-9f90-41bb-b021-ed66c912092d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:53.893126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 191/377] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:53.915163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735192-7408-4304-a46a-c7b1cf8ee5b8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.915671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735192-7408-4304-a46a-c7b1cf8ee5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.916079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735192-7408-4304-a46a-c7b1cf8ee5b8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.917759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 192/378] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:53.925037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:53.925377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:53.925576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:53.953722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:53.956763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:54.073461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf605b-f703-4e36-bffb-f35077769e49 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:54.098261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 193/379] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:54.108681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:54.125094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:54.125718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:54.126061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:54.126326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] PATH_INFO: `/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:54.127437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] RBAC: Authorizing `identity:get_project(project_id=27ae4d0f7c2945c3a5c26ee841ef1a26)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:54.128852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:54.130774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 187/380] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:53 2022] GET /identity/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26 => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:54.138828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:54.170135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:54.246438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0ed7-8d0c-4470-ac63-35af1efd66c0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:54.283014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:54.284411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:54.284865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:54.285363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] PATH_INFO: `/v3/groups/a72798e58d6f4f9f80ed537502e9db02` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:54.291904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] RBAC: Authorizing `identity:get_group(group_id=a72798e58d6f4f9f80ed537502e9db02)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:54.293852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:54.296061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 194/381] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:54 2022] GET /identity/v3/groups/a72798e58d6f4f9f80ed537502e9db02 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:54.302744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:54.421059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436dc0f-9990-4d08-a955-6778947634d4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:54.437471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:54.466488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:54.467400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:54.467879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:54.468314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:54.469460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] RBAC: Adding query filter params (group.id=a72798e58d6f4f9f80ed537502e9db02, role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=27ae4d0f7c2945c3a5c26ee841ef1a26) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:54.470655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:54.473605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:54.486775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 188/382] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:23:54 2022] GET /identity/v3/role_assignments?group.id=a72798e58d6f4f9f80ed537502e9db02&scope.project.id=27ae4d0f7c2945c3a5c26ee841ef1a26&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:54.582405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:54.604069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10483e8-9ab5-4b2f-90a1-8e691ad68cc9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:54.641690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:54.642391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:54.642670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:54.643010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:54.657270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:54.662432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:54.663907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:54.664724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 195/383] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:54.670530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:54.750772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:54.816483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fb3a6-0e35-445b-8fb5-03579c20ab44 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:54.850916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:54.851521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:54.851797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:54.852065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:54.852731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:54.853032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:54.854454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:54.865232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 189/384] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:54.871188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:55.021718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349184-a3f4-48f3-85c2-066b5512f7fb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:55.057174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:55.058055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:55.058502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:55.058921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:55.060194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:55.061795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:55.068064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 196/385] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:54 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:55.070154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:55.196467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f5d01-c978-4d2c-a472-744b896f6b57 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:55.213079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:55.234241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:55.234871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:55.235154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:55.235429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:55.236560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:55.238154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dd280-22d1-4e5c-8a10-f0b451491cec None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:55.239945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 190/386] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:55 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:55.246303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:55.281477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:55.398080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f7351-5485-4d8f-bf8a-e143b204b471 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:55.434180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c65e26-b495-4964-a786-0053d011805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:55.434837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e26-b495-4964-a786-0053d011805b None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:55.435138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e26-b495-4964-a786-0053d011805b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:55.435381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c65e26-b495-4964-a786-0053d011805b None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:55.437299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c65e26-b495-4964-a786-0053d011805b None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, group_id=f8fa65cf2f1c4e13bb555445692bc39c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:55.438761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c65e26-b495-4964-a786-0053d011805b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:55.454105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 197/387] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 15:23:55 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:23:55.649046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf05e-d251-4c21-8349-79594eacc1ee None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:55.649533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf05e-d251-4c21-8349-79594eacc1ee None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:55.649533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bf05e-d251-4c21-8349-79594eacc1ee None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:55.651261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 191/388] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:55.656928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:55.657522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:55.658057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:55.682598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:55.683817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:55.755951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 198/389] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:56.060842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf05e-d251-4c21-8349-79594eacc1ee None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:56.185359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bf05e-d251-4c21-8349-79594eacc1ee None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:56.227389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:56.228025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.228305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.228581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.243478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:56.249193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:56.250281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:56.251100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 192/390] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:56.258973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:56.267486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:56.383879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3b86-bfa7-47c0-a120-a43c6872621a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:56.429459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:56.430145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.430369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.430642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.431308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:56.431614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:56.432986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:56.441866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 199/391] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:56.447760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:56.496977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:56.564214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62423-3f45-4fac-95f8-7ed6add586bf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:56.611579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:56.612629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.613116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.613604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.618622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:56.620548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ccab3-35c3-44df-b6b3-afcdb5363128 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:56.622432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 193/392] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:56 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:56.628105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:56.732057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:56.761706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537144b-26a1-4b7d-8aed-cc0ee5bddf51 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.762269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537144b-26a1-4b7d-8aed-cc0ee5bddf51 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.762269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537144b-26a1-4b7d-8aed-cc0ee5bddf51 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.763844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 194/393] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:23:56.768498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3dbe-e015-44e8-921e-fb742e4989c7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.768775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3dbe-e015-44e8-921e-fb742e4989c7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.769040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3dbe-e015-44e8-921e-fb742e4989c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.770475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6818-7643-4c50-adc3-a8d34b8988fb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:56.787331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-578d3dbe-e015-44e8-921e-fb742e4989c7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:56.788554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-578d3dbe-e015-44e8-921e-fb742e4989c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:56.837038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:56.838197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.838681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.839201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.840701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:56.842523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7618a8-8d42-4209-bbac-dfefddd06981 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:56.844689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 200/394] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:56 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:56.846331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88685-611d-4944-b85d-e627b9aecf84 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.846815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88685-611d-4944-b85d-e627b9aecf84 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.847308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88685-611d-4944-b85d-e627b9aecf84 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.849394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 201/395] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:56.850550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88685-611d-4944-b85d-e627b9aecf84 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:56.859462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 195/396] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:23:56.866454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:56.866750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:56.867026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:56.897771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:56.898951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:56.940901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:56.975716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 196/397] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:56.993801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88685-611d-4944-b85d-e627b9aecf84 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.044186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.044846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.045121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.045386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.050273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db0211d697342999c598ecaa06bbaa3, group_id=f8fa65cf2f1c4e13bb555445692bc39c, role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:57.051761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:57.057705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:57.077759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 202/398] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 15:23:56 2022] PUT /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:57.274505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.314502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.416418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7728a-3c06-49ee-a821-005268a06887 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.462041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.463753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.464432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.466254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.473147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bea3f-95b7-47e7-af0e-b0a526b97114 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.495993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:57.504281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:57.505225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:57.506133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:57.516468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 197/399] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:57.524386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.551451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.552495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.553033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.554186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.566416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:57.585016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:57.590377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:57.591255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:57.592032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 203/400] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:23:57.599088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.659819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:57.670512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36a325-3dca-4832-bc07-252cc32a9592 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.711989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.712606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.712884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.713153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.713869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:57.714191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:57.715790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc1994-a68d-4052-89b2-4c91ec0a489d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:57.719439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d050b7e-e63d-4e89-bd62-3a9cff2a5dd1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.728225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 198/401] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:57.729721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243e03-ac29-449d-9136-caeb2d38e61b None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.730176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243e03-ac29-449d-9136-caeb2d38e61b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.730625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243e03-ac29-449d-9136-caeb2d38e61b None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.732275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 199/402] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:57.734895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243e03-ac29-449d-9136-caeb2d38e61b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.782456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.783317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.783854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.784269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.785076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:57.785535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:57.788179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f227eb-b2de-47ab-96e3-4c45dae97407 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:57.799766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 204/403] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:57.802069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.802518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.802937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.828960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:57.830954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:57.842943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:57.854299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d243e03-ac29-449d-9136-caeb2d38e61b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:57.890994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:57.891841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:57.892252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:57.892723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:57.894025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:57.895792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:57.897995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 200/404] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:57.898907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.922572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 205/405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:57.923647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:57.998023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.069621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcbca6-2b81-415e-ab9f-8fa817e39ccb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.107103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679398-6695-4896-ac83-e17586381d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.107734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679398-6695-4896-ac83-e17586381d2c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.108006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679398-6695-4896-ac83-e17586381d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.108272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43679398-6695-4896-ac83-e17586381d2c None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.109398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43679398-6695-4896-ac83-e17586381d2c None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.110916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43679398-6695-4896-ac83-e17586381d2c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.112785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 201/406] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:58.118767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679398-6695-4896-ac83-e17586381d2c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.123116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f440a-46a9-43c7-80c1-39670152a7ec None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.160278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.186966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.188174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.188892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.189786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.191375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.194068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a31c0-d2af-44a2-bda8-d36303390f4a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.196573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 206/407] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:57 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:58.198811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e15c-3ee9-452f-a8e1-f64c5ea808ab None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.199299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e15c-3ee9-452f-a8e1-f64c5ea808ab None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.200013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e15c-3ee9-452f-a8e1-f64c5ea808ab None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.202613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 207/408] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:58.203488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e15c-3ee9-452f-a8e1-f64c5ea808ab None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.235089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43679398-6695-4896-ac83-e17586381d2c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.270256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.271247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.271722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.272767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.274175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.276140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ca09f-8116-43bb-a186-6eed94c46dfb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.278053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 202/409] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:58.279414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.279914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.280412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.299720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:58.300913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:58.314347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e15c-3ee9-452f-a8e1-f64c5ea808ab None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.330791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.351747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.352392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.352734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.353034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.355056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, group_id=f8fa65cf2f1c4e13bb555445692bc39c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.356464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.370349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 208/410] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 15:23:58 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:58.371125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.392150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 203/411] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:23:58.393627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.434486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.495393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38218cf-fe89-467c-91cc-d7026adf4a95 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.562134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b29c-8dd2-4d9f-a5bd-bb69b6e25753 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.567656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.568300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.568575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.569506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.594913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:58.599725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:58.600733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:23:58.601530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 209/412] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:58.608032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.632558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.633221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.633496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.633785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.635900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] RBAC: Authorizing `identity:create_grant(project_id=a70fbcb83a80479db13599bde38c4fe7, group_id=f8fa65cf2f1c4e13bb555445692bc39c, role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.637926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.659022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 204/413] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 15:23:58 2022] PUT /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7/groups/f8fa65cf2f1c4e13bb555445692bc39c/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:23:58.666614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.730471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.759912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e062c-1afa-437e-870e-dbce7ee9f7b0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.830525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.832143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.833309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.833769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.834834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:58.836588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:58.838232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:58.856935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 210/414] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:58.868617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:58.909899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14435dbb-30da-47d6-9968-32ac5b4ea248 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:58.922129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:58.948406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:58.949234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:58.949612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:58.950003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:58.961436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:23:58.968425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:23:58.969482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:23:58.970493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:23:58.972366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 205/415] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:23:58.981827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:59.051767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:59.059435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672da64a-7bd2-4537-9f7a-d0eb9b7fd9a3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.123095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:59.124016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.124488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.124945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] PATH_INFO: `/v3/groups/a72798e58d6f4f9f80ed537502e9db02` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.126782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] RBAC: Authorizing `identity:get_group(group_id=a72798e58d6f4f9f80ed537502e9db02)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:59.129370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:59.133157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 211/416] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/groups/a72798e58d6f4f9f80ed537502e9db02 => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:23:59.142040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:59.237179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43d216-d879-4b96-94a4-2e074c505e0b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.319221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:59.320271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.320794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.321268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.322489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:23:59.323017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:59.325492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:59.333421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350886-9ab9-4a0a-bd26-95cc9a941af4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.340233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 206/417] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:23:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:59.349151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:59.370910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:59.395169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:59.396023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.396498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.396996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] PATH_INFO: `/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.400317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] RBAC: Authorizing `identity:get_project(project_id=27ae4d0f7c2945c3a5c26ee841ef1a26)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:59.403224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:59.405651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 212/418] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:59 2022] GET /identity/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26 => generated 344 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:23:59.415534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:59.521665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa42a97-c107-4401-b842-ef6270823b9d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.525112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:59.560693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:59.561586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.562099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.562536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.634029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:59.635717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9e59-bc02-4df4-a54e-abb51c992947 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:59.647341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:59.687959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659c1b0-7ed0-4357-b0bd-853d9c7efb1a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.749804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 207/419] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 15:23:59.755646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:23:59.755646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.755646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.755646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] PATH_INFO: `/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26/groups/a72798e58d6f4f9f80ed537502e9db02/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.756208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=27ae4d0f7c2945c3a5c26ee841ef1a26, group_id=a72798e58d6f4f9f80ed537502e9db02, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:23:59.756208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68345c-d598-40b5-8e89-8570d3610e86 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:23:59.757155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d07f-c8fd-41f4-a5c7-5dd06405f9c8 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.757648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d07f-c8fd-41f4-a5c7-5dd06405f9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.758156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379d07f-c8fd-41f4-a5c7-5dd06405f9c8 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.760051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 208/420] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:23:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:23:59.761050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379d07f-c8fd-41f4-a5c7-5dd06405f9c8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:23:59.779008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 213/421] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 15:23:59 2022] PUT /identity/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26/groups/a72798e58d6f4f9f80ed537502e9db02/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:23:59.780956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:23:59.781282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:23:59.781597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:23:59.834212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:23:59.835847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:23:59.934120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379d07f-c8fd-41f4-a5c7-5dd06405f9c8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:23:59.955940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:23:59.992167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 214/422] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:00.001587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.002517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.003040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.003530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.004847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:00.007093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:00.008900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 209/423] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:23:59 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:00.015193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:00.042114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:00.119504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37407a-6a8f-489a-a79d-17ab2bdbdd87 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:00.155856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.156772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.157257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.157701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.159038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:00.160739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:00.162847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 215/424] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:24:00 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:00.168900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:00.275934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5adfd-7177-4e43-8be8-ac43a57b2b14 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:00.311985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.312898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.313372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.313842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.314729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=6db0211d697342999c598ecaa06bbaa3) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:00.315339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:00.317005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:00.324193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 210/425] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:24:00 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=85c18124c6384ec5be995afe6ae23067 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:00.447306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:00.548775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:00.557643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8137ac-160e-43d0-b648-c97a8b4a5cfa None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:00.594288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.594914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.595191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.595461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.606070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:00.610783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:00.611649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:00.612852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 216/426] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:00.618527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:00.663480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:00.726210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c204c-2bbb-4653-99f7-5cf4244b02b3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:00.761263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.761911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.762191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.762463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.763133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:00.763437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:00.764858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:00.773871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 211/427] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:00.779853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:00.884758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdaed1-db60-47d7-9af1-74da86b7ac21 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:00.922191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725234f-071d-4113-98ff-4930be9baede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:00.922810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725234f-071d-4113-98ff-4930be9baede None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:00.923088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725234f-071d-4113-98ff-4930be9baede None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:00.923359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725234f-071d-4113-98ff-4930be9baede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:00.946169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.001977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725234f-071d-4113-98ff-4930be9baede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:01.003454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725234f-071d-4113-98ff-4930be9baede None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:01.118296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 217/428] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:01.124169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.235784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f36-9000-44e7-a105-e245fcd3bbbf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.236109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f36-9000-44e7-a105-e245fcd3bbbf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.236325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9f36-9000-44e7-a105-e245fcd3bbbf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.237779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 218/429] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:01.242764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664006-645e-4ee5-b993-9fdf2423429e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.243046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664006-645e-4ee5-b993-9fdf2423429e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.243317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28664006-645e-4ee5-b993-9fdf2423429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.248817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7acc4c-7170-4f9b-b865-9effe7a01f65 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.250508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.268722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-28664006-645e-4ee5-b993-9fdf2423429e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:01.269943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-28664006-645e-4ee5-b993-9fdf2423429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:01.292322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.293026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.293314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.293589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] PATH_INFO: `/v3/projects/6db0211d697342999c598ecaa06bbaa3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.295799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=6db0211d697342999c598ecaa06bbaa3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:01.298359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69c0e-ddc6-4e9c-9c01-aa9fcd7bf2e9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:01.300594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 212/430] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/projects/6db0211d697342999c598ecaa06bbaa3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:01.306915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e05d-305b-4df1-90df-9926f634fadc None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.307277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e05d-305b-4df1-90df-9926f634fadc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.307633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e05d-305b-4df1-90df-9926f634fadc None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.309255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 213/431] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:01.312019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e05d-305b-4df1-90df-9926f634fadc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.328779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.354737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 219/432] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:01.356462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.356882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.357184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.375383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:01.376576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:01.444179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e05d-305b-4df1-90df-9926f634fadc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.464427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 220/433] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:01.490470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.490470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.490787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.491143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.492229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:01.493656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:01.495419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 214/434] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:01.501347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.605127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9a3ac-307f-4786-b6a4-111b60509d5c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.618650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.637042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.641875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.642480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.642757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.643020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.643740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=6db0211d697342999c598ecaa06bbaa3) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:01.644039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:01.645460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:01.653790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 221/435] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=6db0211d697342999c598ecaa06bbaa3&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:01.691426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.751867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af992e69-430b-4c61-9637-d1eca6ba2b2c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.784472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.791098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.791749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.792028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.792297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.810857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:01.817086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:01.818100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:01.819029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 215/436] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:01.824398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.910564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af126f49-3350-4cc7-a1d9-ee1c8d68ed0e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.932619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:01.937585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe7fa7-83d4-4c75-8ce2-bd6f5ee15bb7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:01.953192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.953873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.954132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.954402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.968254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:01.973494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:01.974390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:01.975744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:01.976346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 222/437] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:01.981179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:01.983028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:01.983647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:01.983916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:01.984184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:01.984849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:01.985146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:01.986733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:01.997753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 216/438] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:02.002612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.032815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.115442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f51dc3-0e42-4dea-8100-0eb13e14ba32 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.139095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5be6b-acd2-4a46-8a69-2898d373bbe2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.161318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.162078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.162931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.163199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.163868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:02.164480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.165716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.176413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 223/439] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:02.182043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.190706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.191320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.191591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.192017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.225157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.275259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.276623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf596c4-4e8a-4bf7-a0af-8ae233e13cf3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.289122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.293102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473843e-47ec-4efa-840a-3ae98cd103da None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.330549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.331157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.331585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.331862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.379759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 217/440] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:02.380994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4717c-f887-41aa-b1cd-350bf4279328 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.381836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4717c-f887-41aa-b1cd-350bf4279328 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.382097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4717c-f887-41aa-b1cd-350bf4279328 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.383312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 218/441] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:02.386596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4717c-f887-41aa-b1cd-350bf4279328 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.403424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.404874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d4a39-cc94-47d6-b15e-0abd17317726 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.445346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.486602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4717c-f887-41aa-b1cd-350bf4279328 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.497778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.503728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 224/442] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:02.505213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.505501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.505802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.524272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:02.525783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:02.526586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.527209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.527489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.527758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.528857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.530390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.531999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 219/443] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:02.532765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.594946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 225/444] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:02.595779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.645019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93002523-1370-4696-92d5-a3c0014d9a0d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.672774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.683307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.683737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.684077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.684408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] PATH_INFO: `/v3/projects/a70fbcb83a80479db13599bde38c4fe7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.685512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=a70fbcb83a80479db13599bde38c4fe7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.686959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.688713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 220/445] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/projects/a70fbcb83a80479db13599bde38c4fe7 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:02.694105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.701223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62def56-a615-4b91-89a6-199ec07fb47e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.728414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.738638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.739260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.739535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.739808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.741418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.743296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.745695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 226/446] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:02.751125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.807132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e9c6-bce9-4504-badf-43e2ae343ed8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.843451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.844065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.844337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.844601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] PATH_INFO: `/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.845719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] RBAC: Authorizing `identity:get_group(group_id=f8fa65cf2f1c4e13bb555445692bc39c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.847150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.848846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 221/447] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/groups/f8fa65cf2f1c4e13bb555445692bc39c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:02.851939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f022752-f79d-42e3-9f5a-3095a3fd16e2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.854286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.886028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:02.886621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:02.886896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:02.887164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:02.887878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=85c18124c6384ec5be995afe6ae23067, scope.project.id=a70fbcb83a80479db13599bde38c4fe7) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:02.888183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:02.889599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:02.895401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 227/448] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=85c18124c6384ec5be995afe6ae23067 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:02.896040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:02.920518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:02.963051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b7cc-e2c7-40a5-b596-fd3b5f4f6d56 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:02.969021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:03.003740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.004396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.004663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.004934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.005664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] RBAC: Adding query filter params (group.id=f8fa65cf2f1c4e13bb555445692bc39c, role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=a70fbcb83a80479db13599bde38c4fe7) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:03.006526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.008105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.013982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad255f9-b139-462e-86d2-7c2a711751a8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.022271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 222/449] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/role_assignments?group.id=f8fa65cf2f1c4e13bb555445692bc39c&scope.project.id=a70fbcb83a80479db13599bde38c4fe7&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:03.061767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.062438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.062789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.063130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.076794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:03.081959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:03.082944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:03.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 228/450] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:03.091889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:03.211044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e351b-7ff5-42b1-93c2-edcb2aa3e479 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.237927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:03.246745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.247354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.248589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.248589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.248751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:03.249043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.250427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.259768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 223/451] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:03.265364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:03.368632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b49369-41ec-45e5-bf15-d34151009c80 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.389051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:03.403471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.404064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.404338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.404602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.470220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.471664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.574220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 229/452] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:03.580058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:03.676720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc26c-dc47-4eae-8890-c6634517fc3d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.708848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.709495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.709913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.710203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] PATH_INFO: `/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.711308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=27ae4d0f7c2945c3a5c26ee841ef1a26)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.712743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.714375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 224/453] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:24:03 2022] GET /identity/v3/projects/27ae4d0f7c2945c3a5c26ee841ef1a26 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:03.719880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:03.741020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:03.816286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768525e-961a-42da-8197-8da2ceda11c7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.847482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.848083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.848355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.848620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] PATH_INFO: `/v3/groups/a72798e58d6f4f9f80ed537502e9db02` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.849676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] RBAC: Authorizing `identity:get_group(group_id=a72798e58d6f4f9f80ed537502e9db02)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.851634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975f87-f0b9-44da-8d93-2b7f1dfab198 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.853138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 230/454] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 15:24:03 2022] GET /identity/v3/groups/a72798e58d6f4f9f80ed537502e9db02 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:03.858804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:03.915301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:03.956688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5094-9f4b-4067-9edd-c8143a8ee0e8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:03.988698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:03.989292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:03.989573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:03.989877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:03.991227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] RBAC: Adding query filter params (group.id=a72798e58d6f4f9f80ed537502e9db02, role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=27ae4d0f7c2945c3a5c26ee841ef1a26) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:03.991540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:03.992955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f44f3d-cf3f-43f9-b899-d371a8df200c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:03.998517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 225/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 15:24:03 2022] GET /identity/v3/role_assignments?group.id=a72798e58d6f4f9f80ed537502e9db02&scope.project.id=27ae4d0f7c2945c3a5c26ee841ef1a26&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:06.598652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338390-896d-4f4b-bf6b-9f2a5a8cb618 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:06.599284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338390-896d-4f4b-bf6b-9f2a5a8cb618 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:06.599284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338390-896d-4f4b-bf6b-9f2a5a8cb618 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:06.601242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 231/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:06.607010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4f90-bbde-4724-a0dd-972cc3fa15d1 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:06.607438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4f90-bbde-4724-a0dd-972cc3fa15d1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:06.607637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4f90-bbde-4724-a0dd-972cc3fa15d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:06.635248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e8ed4f90-bbde-4724-a0dd-972cc3fa15d1 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:06.637051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e8ed4f90-bbde-4724-a0dd-972cc3fa15d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:06.733425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 226/457] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:06.907684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591ab5-50ba-4b7a-8176-86fd4d85d198 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:06.907876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591ab5-50ba-4b7a-8176-86fd4d85d198 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:06.908130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97591ab5-50ba-4b7a-8176-86fd4d85d198 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:06.909610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 232/458] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:06.919702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df638c9c-bb61-4efe-9295-01d56872dbc9 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:06.919995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df638c9c-bb61-4efe-9295-01d56872dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:06.920267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df638c9c-bb61-4efe-9295-01d56872dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:06.955656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-df638c9c-bb61-4efe-9295-01d56872dbc9 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:06.956847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df638c9c-bb61-4efe-9295-01d56872dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:07.023252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.032530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97591ab5-50ba-4b7a-8176-86fd4d85d198 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.050666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 227/459] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:07.088445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcecb-d3bc-458b-9068-79e43a9d9922 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.088772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcecb-d3bc-458b-9068-79e43a9d9922 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.088997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dcecb-d3bc-458b-9068-79e43a9d9922 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.090772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 228/460] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:07.096064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.096348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.096618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.130210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.138206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:07.139280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:07.150685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97591ab5-50ba-4b7a-8176-86fd4d85d198 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.212189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.213384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.216280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.216805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.231189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 229/461] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:07.235778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.237586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:07.253475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:07.254471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:07.255375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:07.255375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.255375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:07.261947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 233/462] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:07.264143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.379783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf4ccb-6568-4b18-a5d4-4ac710fa321c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.393940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.426602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.427650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.428795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.429277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.430187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:07.430719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.432996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.443844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.472137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 230/463] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:07.495257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.591268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869aaf-9699-4d67-8053-a1e2596841ae None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.622017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34cb43-7400-49ba-b6de-cdab8fd019c8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.627585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.628213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.628491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.628762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.639411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.641423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.643518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.657099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.657709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.658023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.658290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.658922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:07.659852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:07.660708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:07.662170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:07.662170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.662170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:07.662347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffa10-8dd0-4b37-9a24-43b1a94d4e58 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.662420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 234/464] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:07.662420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.689901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 231/465] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:07 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:07.692438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea82-8528-4340-832e-3f3a0bfa5c7d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.693883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea82-8528-4340-832e-3f3a0bfa5c7d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.694870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea82-8528-4340-832e-3f3a0bfa5c7d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.697503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 232/466] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:07.698604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aea82-8528-4340-832e-3f3a0bfa5c7d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.745213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.785454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916be9e6-9e32-490a-a593-bf4247a053e9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.826332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.826994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.827297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.827541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.839621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.841109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.862178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aea82-8528-4340-832e-3f3a0bfa5c7d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-709a0a4a-80d4-49a3-b154-f9025f967e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:07.862845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:07.863712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:07.864937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:07.864937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:07.864937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:07.864937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 235/467] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:07.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.866083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.867268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.891503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:07.893169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:07.899690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:07.900547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:07.900825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:07.901092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:07.901747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:07.902070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:07.903423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:07.916932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 233/468] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:07.918008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:07.941942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:07.976826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 236/469] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:07.978069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.039753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:08.076924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0984497-ec6a-4abd-87fb-82ba5ed8c0f7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.115997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaa804-94e9-41d6-bf03-55acf7a1e115 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.158759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.159809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.160090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.160363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.161160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.163328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.174440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.175475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.176087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.176917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.178612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:08.179021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.180656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c44fb2-81d4-4006-b92e-d48f7c5bf1f2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.187661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 237/470] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:07 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:08.204154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 234/471] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:08.206711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.229503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c77a-d858-44e5-9fa5-fc33d26e180b None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.229851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c77a-d858-44e5-9fa5-fc33d26e180b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.230083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c77a-d858-44e5-9fa5-fc33d26e180b None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.231957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 235/472] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:08.237371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.237559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.237879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.269247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:08.270494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:08.280507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:08.370334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 236/473] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:24:08.371230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.383515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8696-b174-4837-9b5b-2ba8501040ca None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.427207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.428363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.428651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.428921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.429568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.431279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.462100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 238/474] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:08 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:08.482296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:08.518901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9680d5-db05-4473-a622-a78d90f893c9 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.560984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.561681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.561991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.562263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.574340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.575817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:08.593242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:08.594238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:08.595067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:08.595067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:08.595067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.595067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 237/475] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:08.601042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.658622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.706938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:08.735668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2c26-653b-4cff-bca5-fd11e6c158f9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.781931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.782946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.784440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.784440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.785236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:08.786161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.788499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.796053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db4ac-a549-4042-9825-e85340e2848f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:08.808165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 239/476] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:08.815548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.842950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:08.851516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:08.852577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:08.853065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:08.853566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:08.855713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:08.857686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:08.868487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.sql.core [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 15:24:08.868487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 15:24:08.868487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [parameters: {'id': '502c2ddce4c94bdeaa51d8647111bcb7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 15:24:08.868487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:24:08.891206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return ref.to_dict() Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:24:08.892199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application yield resource Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise self.value Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application session.commit() Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 15:24:08.893156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.flush() Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application compat.raise_( Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 15:24:08.894146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:24:08.895069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:24:08.898052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [parameters: {'id': '502c2ddce4c94bdeaa51d8647111bcb7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:08.900401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 15:24:08.903121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:08.905253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 238/477] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 15:24:08 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:08.905253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:08.964041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c109b-fb21-4fb8-859d-75ae16a83ae3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:09.025214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:09.033998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:09.034313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:09.034594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:09.035557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:09.036817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:09.055720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82c40-8f27-4481-a8dd-7b02ea264555 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:09.079261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 240/478] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:08 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:24:09.098159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:09.099257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:09.099792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:09.100266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:09.113245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-d5b68252-1e99-4e6a-bdbc-2b1797d36178 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:09.119535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:09.120556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 15:24:09.121373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:09.127668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 239/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:09.134891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:09.138175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:09.272754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253803f-4527-4301-bc3c-cd38e5e422fc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:09.331927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:09.332551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:09.332826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:09.333095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:09.333791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:09.334202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:09.335598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb07d2-0eb9-4edc-85a6-eecbbd5b22a8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:09.344935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 241/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:10.573366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaa3f5-f7d7-45fa-b16b-950fcd45e13d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:10.573962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaa3f5-f7d7-45fa-b16b-950fcd45e13d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:10.573962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaa3f5-f7d7-45fa-b16b-950fcd45e13d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:10.575440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 240/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:10.580590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b89d7-784b-4237-a24f-cf69a04bec5d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:10.581028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b89d7-784b-4237-a24f-cf69a04bec5d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:10.581132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b89d7-784b-4237-a24f-cf69a04bec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:10.610706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-670b89d7-784b-4237-a24f-cf69a04bec5d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:10.611878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-670b89d7-784b-4237-a24f-cf69a04bec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:10.700505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:10.706263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 242/482] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:10.958184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7630f-8e56-4c70-98b8-ef513547d0ac None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:10.958368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7630f-8e56-4c70-98b8-ef513547d0ac None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:10.958643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7630f-8e56-4c70-98b8-ef513547d0ac None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:10.960294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 241/483] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:10.965114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:10.965399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:10.965668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:10.991551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:10.992729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:11.074867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 243/484] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:11.086651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7630f-8e56-4c70-98b8-ef513547d0ac None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.168308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:11.227364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7630f-8e56-4c70-98b8-ef513547d0ac None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:11.271184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:11.271909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.272192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.272468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.283822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-57302578-99d0-4ef0-9010-9b5ecb1b1ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:11.291985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:11.292863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:11.293658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 242/485] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:11.303352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.397520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe5a0-6d51-43df-9159-afc6df4af4b5 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.397868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe5a0-6d51-43df-9159-afc6df4af4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.398100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe5a0-6d51-43df-9159-afc6df4af4b5 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.402243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 243/486] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:11.405650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe5a0-6d51-43df-9159-afc6df4af4b5 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.443895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad5114-ede4-4886-b544-76d76ab42d11 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:11.468072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:11.479863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:11.480391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.480829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.481108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.481788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:11.482090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:11.483446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd219048-48f4-414f-b93d-77ab423889b2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:11.492616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 244/487] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:11.493652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.493963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.494229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.512288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:11.513454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:11.540443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe5a0-6d51-43df-9159-afc6df4af4b5 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:11.558746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:11.584997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:11.585659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 245/488] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:11.586614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.587382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.587859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.588323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.604041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:11.610604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:11.611503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:11.612392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:11.615269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 244/489] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:11.625414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.740912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75f573-7d79-4de0-b008-e21aebccb609 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:11.780396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc106a86-e0e5-4e85-ae66-e06f6a5a0cf3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:11.781345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:11.782206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.784018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.784496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.785350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:11.786051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:11.789066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:11.805067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 245/490] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:11.811478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.815778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:11.854469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:11.855438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:11.855940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:11.856404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:11.869965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:11.872509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:11.886726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:11.890165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:11.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:11.892051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:11.892051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:11.892051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:11.894572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 246/491] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:11.895594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:11.968575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95dce2-73a6-424d-ac5c-61b20af7f13c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.016417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.017615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.018534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.019288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.024431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78565810-2483-4a5f-b215-69b512625b39 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.033115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.035271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:12.052557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:12.053548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:12.054404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:12.054404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:12.054404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:12.055278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 246/492] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:12.056016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.064421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.065037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.065310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.065575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.077060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:12.082774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:12.083690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:12.085078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:12.089074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 247/493] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:12.090345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.120002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.156354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.169293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62a2dc-e664-469c-af3d-4ba8afe842be None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.192113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b2d2a-443b-46ac-bc84-7cd93620d341 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.201267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.201887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.202165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.202432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.203062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.203358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.204722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.216981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 247/494] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.217788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.229541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.230168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.230441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.230704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.231339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.231634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.233015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63342465-4ff4-4874-b5c4-5ad24376e1ed None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.244547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.245667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d38a2-abba-4e19-8daa-a98cd0ff307a None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.245976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d38a2-abba-4e19-8daa-a98cd0ff307a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.246365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d38a2-abba-4e19-8daa-a98cd0ff307a None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.247548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 249/496] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:12.249869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f361c8-4d84-4f1e-89c8-abab4779b8a0 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.249869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f361c8-4d84-4f1e-89c8-abab4779b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.249869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f361c8-4d84-4f1e-89c8-abab4779b8a0 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.250229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 250/497] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:12.250905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f361c8-4d84-4f1e-89c8-abab4779b8a0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.318014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6b7d0-f007-49f6-bd7b-65045a0f5b48 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.336368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.349015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f361c8-4d84-4f1e-89c8-abab4779b8a0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.352661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.353257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.353535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.353860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.354519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.354821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.356174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.363943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 248/498] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.364719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.376956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.387933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.388546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.388821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.389088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.395925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.397888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ddc9a594-8c52-455f-8562-0c7659d3b1e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:12.410621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:12.411767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 251/499] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:12.412846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61cef-4859-496d-bff5-c7fd083197a3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.413460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61cef-4859-496d-bff5-c7fd083197a3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.413460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae61cef-4859-496d-bff5-c7fd083197a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.430946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1ae61cef-4859-496d-bff5-c7fd083197a3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:12.432139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1ae61cef-4859-496d-bff5-c7fd083197a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:12.468744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e57e0f-5e73-466e-b994-590c4a9c6e73 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.495787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 252/500] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:12.497175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.497468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.497754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.502103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.502724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.503003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.503273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.510800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.512265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.516460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:12.517648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:12.525795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:12.526851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:12.527941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:12.529609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 249/501] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:12.530391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.596990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 253/502] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:12.597765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.613662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.618778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.653469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369790e-f5f0-4013-ae06-52141415f7ae None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.711864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.715842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.716531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.718022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.727005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93551b8c-bbf4-405f-a495-db396e8ddd34 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.732945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.734549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:12.752631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:12.753565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:12.754454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:12.754454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:12.754454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:12.757858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 250/503] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:12.759746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.768543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.769147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.769420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.769686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.770469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.770769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.772748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.808117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 254/504] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.808925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.872253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b5fa-af84-440a-ba3f-0d8d44a3ce32 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.873717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.895993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:12.909188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.909808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.910084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.910353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.911067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.911375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.912810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.914512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51cb47-9a09-4bd6-9d36-3c748b1e4a85 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:12.947237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:12.947832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:12.948104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:12.948339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 251/505] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.948428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:12.948999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:12.949148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:12.949299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:12.950697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:12.962668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 255/506] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:12.963350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.054249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb3900-98ee-422a-8254-c8e6d9ca8138 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.071666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d9ac6-418a-45b6-ae27-7b50f6e640fb None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.087087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.087708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.087984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.088257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.096008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.098289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:13.103043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:13.103972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:13.104752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 252/507] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:13.105461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.107199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.107797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.108073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.108341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.147543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.173805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.175297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.205567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2081-475d-4a85-aea9-4a48c978ba67 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.237951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.238572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.238844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.239111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.249812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.251257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:13.265894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:13.266971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:13.267830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:13.267830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.267830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:13.267830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 253/508] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:13.267830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.272912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 256/509] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:13.273807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.299594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.364927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.376572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5162453-df9d-47eb-978a-61d768e3def7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.379556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d6b0-4a3a-4fda-af3c-9f0fecbad4dd None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.415546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.416180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.416458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.416739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.423058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.423058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.423058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.423058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.430613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.432044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:13.443135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:13.443997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 257/510] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:13.449498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.483690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.485151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.527065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.542611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0728e-dd73-4c97-a0b7-3f4124074ee4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.573860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.575639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.576232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.576510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.576786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.577439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:13.577908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.579121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.588216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 254/511] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:13.588216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.588421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 258/512] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:13.589093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.687191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010a1c2-df07-4bdd-a87b-ec83c21442ae None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.691204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9c2c-b576-42ad-9cf8-ccee03b3e234 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.724378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.725468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.725758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.726031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.726665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:13.726972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.727829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.728326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.728483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.728717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.728983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.739494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.741565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.742313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 255/513] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:13.743831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.749758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:13.756554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:13.757527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:13.758720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:13.758720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.758720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:13.758720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 259/514] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:13.758720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.800417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.847529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f5cb4-4acd-47d0-a41f-f34030a1d479 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.855902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa57a-6ea9-497f-a5ee-9235e00fe600 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:13.879694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.880287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.880564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.880863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.881578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:13.881913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.883331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.887893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:13.888505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:13.888781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:13.889050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:13.899594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:13.900228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 256/515] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:13.901000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.901373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:13.917796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:13.918730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:13.919969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:13.919969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:13.919969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:13.919969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 260/516] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:13.919969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:13.972789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:13.999849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74691-1e84-4c5e-9005-09341fbfd9bd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.010860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.022244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c700f9-3b79-4b68-98d1-787e90686436 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.035513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.036139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.036415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.036683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.048904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.051348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.060607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.061215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.061479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.061774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.062422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.063845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:14.070683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:14.071713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:14.072706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:14.072706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:14.072706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:14.072706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 257/517] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:14.073331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.089219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 261/518] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:13 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:14.090081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.193406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb324d8-903b-47d1-befb-84ab07e31cd3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.209059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209363f-e734-4e15-9912-f267e1564905 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.219459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.233120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.233630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.233938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.234210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.234870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:14.235179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.236614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.249772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 258/519] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:14.250497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.250703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.251610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.252024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.252480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.279750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.334756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.336217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.370489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c714a-c348-4470-862e-74af21fbec5e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.411529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.412618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.412892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.413161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.413825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:14.414124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.415473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.429350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 259/520] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:14.430493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.457753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 262/521] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:14.462505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.468444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.531512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.553999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bd0e8-5702-41b0-96eb-9a90768cb37f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.557828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068cc-62bc-49f5-aee7-ec2ce79d8ea1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.591736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.592390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.592632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.592902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.593494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.594159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.594438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.594709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.595348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:14.595652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.597012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.602457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.604090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.610408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 260/522] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:14.611225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:14.616892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:14.617790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:14.618816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:14.623320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.700918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.736749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a5c89-355c-4956-895c-5bf0c44cf3fa None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.739225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b0087-1ab3-4318-b25c-14be968520dc None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.769877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.770495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.770782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.771029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.773826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.774445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.774722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.775253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.782145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.782482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.783528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.783932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:14.795964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:14.796810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:14.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:14.798245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.800764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:14.804035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:14.804954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:14.805857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:14.805857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:14.805857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:14.805857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 264/525] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:14.806495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.910881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8de08-ab57-4438-b227-89455ebe77ee None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.918895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3308-dc28-48c3-ac03-8155b0becdf8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:14.932419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:14.947029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.947634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.947910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.948179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.948860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:14.949159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.950623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.957048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:14.957668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:14.957972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:14.958241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:14.966346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:14.967719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:14.968357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 265/526] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:14.973218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:14.984019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:14.984937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:14.985854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 262/527] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:14.986406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.061830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.085321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5fef6-126a-4641-81f6-346b1e9e755c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.104518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe169-291c-4201-9a42-ac97e1cd2ff3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.119448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.120071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.120343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.120607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.121278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.121578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.123011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.134528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 266/528] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.135127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.142894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.143494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.144016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.144016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.144657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.144957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.146367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.158945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 263/529] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.159570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.181884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.242943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a36f4d-8b64-46ee-9535-f9a5ed3e1e87 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.264455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf593f3-aecb-43bf-936d-3725092d47a2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.277095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.277694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.278000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.278271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.278980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.279283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.280711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.286059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 267/530] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.286821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.300622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.315412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.316351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.316767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.317196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.318209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.318681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.320366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.344172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 264/531] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.345282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.434741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a82a9-f29f-4922-a1f4-0debb5400768 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.438586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.475467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466a5a5-9395-4944-8432-2c57aee998a9 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.485064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120df2-d105-450b-b822-7577b8019363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.485675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120df2-d105-450b-b822-7577b8019363 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.485978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120df2-d105-450b-b822-7577b8019363 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.486246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120df2-d105-450b-b822-7577b8019363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.487880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120df2-d105-450b-b822-7577b8019363 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=57733217d148407dbc9bce988253441e) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.487880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120df2-d105-450b-b822-7577b8019363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.489133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120df2-d105-450b-b822-7577b8019363 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.498328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 268/532] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/role_assignments?user.id=57733217d148407dbc9bce988253441e&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.499123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120df2-d105-450b-b822-7577b8019363 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.526100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.527047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.527337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.527603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.546172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.547757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:15.567090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:15.568017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:15.569453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:15.571644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 265/533] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:15.574556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.648563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.720965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120df2-d105-450b-b822-7577b8019363 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.766140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.767119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.767697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.768826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.771691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ae22-7bf6-4f54-9f3a-8f83f682b8f7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:15.842539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:15.844335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:15.844881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:15.851940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:15.852468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:15.853657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:15.854195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.855873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:15.892345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 266/534] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:15.899359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:15.927407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:15.928818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:16.009390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:16.020332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74bedb-2555-4440-b092-cf846eb64965 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:16.087712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:16.088322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.088603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.088856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.089577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=039bd7079482417f8fc2727ee1ee1c31) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:16.089905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:16.091338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:16.101500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 267/535] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/role_assignments?user.id=039bd7079482417f8fc2727ee1ee1c31&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:16.130943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 269/536] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:16.136653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:16.279418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518392b-d1ba-4ad3-8a3c-3a077e774efb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:16.321375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:16.322405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.322948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.323233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.334566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:16.336037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-ae68a34b-ad4e-4b25-a332-991f3b453cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:16.357412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:16.358348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:16.359287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:16.359287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:16.359287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:16.361321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:16.369858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:16.412880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527454-8be7-40d4-a3b5-2465da9c4195 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.413527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527454-8be7-40d4-a3b5-2465da9c4195 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.414010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b527454-8be7-40d4-a3b5-2465da9c4195 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.415972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 269/538] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:16.426155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.426748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.427236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.465085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:16.466345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:16.474083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:16.495878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:16.516757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b864b4-9bb9-48b0-9d55-a9e26844f9ae None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:16.556435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:16.557050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.557329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.557602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.558301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:16.558751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:16.560335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:16.578661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 270/539] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:16.584570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:16.636630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 270/540] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:24:16.748389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512333-fd5e-426e-9252-d646e7ff9d43 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:16.788348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:16.797165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:16.798020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.798297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.798567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.808717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:16.810181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:16.830906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:16.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:16.832534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 271/541] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:16.838146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:16.921990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:16.956702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bc2c5-0187-45e2-b51c-bc6f3541204f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:16.997419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:16.998130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:16.998408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:16.998681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:16.999370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:16.999673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:17.001097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:17.016093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 271/542] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:17.026778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:17.044278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:17.060236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d531d-9881-4a36-8586-b52cd6bbbe14 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:17.130156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:17.130816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.131089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.131355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.155007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:17.163821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:17.165920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:17.167863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:17.174082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 272/543] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:17.174955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:17.228026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f726a-8dae-4d42-aa59-83f9f94c3eec None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:17.266578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:17.299619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:17.300236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.300510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.302015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.302767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=ac90a40ddbfb4c79bc6941adb9498146) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:17.303075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:17.304489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:17.322786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 272/544] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:17 2022] GET /identity/v3/role_assignments?user.id=ac90a40ddbfb4c79bc6941adb9498146&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:17.364230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f966b0-9b23-42f0-b88a-10eb6a07d57b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:17.412169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:17.412859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.413138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.413408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.414109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:17.414407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:17.415808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:17.427575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 273/545] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:17.433456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:17.529486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:17.561647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07989f-5838-4439-8582-16a06cde3882 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:17.595833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:17.596461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.596734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.597003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.608878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:17.610446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-78e43ba0-71d9-41d7-b58e-8c61dd1e5494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:17.626897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:17.627902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:17.628745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:17.628745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:17.628745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:17.628745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 273/546] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:17.635172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:17.769007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240334b1-d54a-4640-9d7f-bd5b873b2e55 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.769327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240334b1-d54a-4640-9d7f-bd5b873b2e55 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.769552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240334b1-d54a-4640-9d7f-bd5b873b2e55 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.771703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 274/547] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:17.781712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.782271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.782783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.798582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c61649-65d5-47f1-8c41-f1b368853510 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:17.818099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:17.820438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:17.821693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:17.864039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:17.864651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:17.865847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:17.866136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:17.866784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:17.867089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:17.868465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:17.892656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:17.901201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:17.992065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 275/549] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:18.015065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57116e95-4bee-4294-90af-462a49cd4ec8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.051143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.051777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.052054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.052325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.060270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.061723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:18.073386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:18.074812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:18.075877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:18.082822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.173741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.233095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b93f4-0c01-42e6-b9b8-db8b82d63cab None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.284888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.285892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.286379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.287412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.288371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:18.288884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.290597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:18.298359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.315523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 276/551] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:18.329416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.347302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.426185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d30a-0463-405f-89ed-b6330120c861 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.495918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c84e21-22a3-4f5f-aad4-54a61efa4aae None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.509703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.510399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.510654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.510926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.511030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.525286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-161bb487-5efa-4c1f-9b50-f304e94606c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:18.532326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:18.533411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:18.534615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:18.535364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b9a3-091a-4e80-a707-ab67f9d334fd None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.535364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b9a3-091a-4e80-a707-ab67f9d334fd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.535501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3b9a3-091a-4e80-a707-ab67f9d334fd None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.539000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 277/553] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:18.542084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3b9a3-091a-4e80-a707-ab67f9d334fd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.557747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.558891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.559463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.559946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.637651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.639121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed72a-b906-441a-a2af-5f34fe56fdb3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:18.644217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.656829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3b9a3-091a-4e80-a707-ab67f9d334fd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.696772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.696772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.696772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.696772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.697120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:18.697120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.698191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0140de4-942c-4d88-9248-76ef43d7dd38 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:18.712270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 278/554] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:18.712270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.712270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.712270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.729258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:18.730565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 277/555] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820054d-b9c9-49ab-b6b2-e0998e6d43be None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820054d-b9c9-49ab-b6b2-e0998e6d43be None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820054d-b9c9-49ab-b6b2-e0998e6d43be None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 278/556] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:18.752783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820054d-b9c9-49ab-b6b2-e0998e6d43be None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.765484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.806966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 279/557] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:18.807771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:18.874932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820054d-b9c9-49ab-b6b2-e0998e6d43be None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.918265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.919269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.919744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.920251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.921543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:18.933463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.935456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:18.945557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9cba-4ee0-407c-aa32-92aaff7c4215 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-afeaefd5-df03-42e9-b28e-563e8cf70e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:18.951657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:18.952548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:18.953464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:18.953464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:18.953464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:18.959998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 279/558] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:18.961594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.962091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.962557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.982553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:18.983515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:18.984139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:18.984470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:18.984946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:18.985370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:18.998249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:18.999994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:19.019890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:19.020855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:19.022348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:19.022348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:19.022348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:19.025806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 280/559] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:19.026796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.058611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.071553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 280/560] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:19.072735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.151483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877782-0c80-4f59-b99f-c762ef2c116b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.179365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631b486-88c9-495c-8da2-7e155e974c51 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.195347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.196647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.197376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.197849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.198914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.199748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.201297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.203637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.216597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.217205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.217483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.217776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.218422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.218722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.220097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.225635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 281/561] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.227317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.242222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 281/562] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.243293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.301867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.353366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbe5f8-3c8e-4c55-9d2c-456398fccdf0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.361263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8fa24-e20d-475f-83b5-fb6eb8977b1a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.392518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.393135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.393411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.393677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.401825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.402680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.403163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.403602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.403868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:19.408554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:19.409447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:19.410296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 282/563] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:19.411038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.416102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.417914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:19.430625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:19.431760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:19.432895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:19.434696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:19.435682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.472316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.517374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a61d7-fec7-4d2c-99d4-ee5ed70ed5da None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.545473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d114d3c-011b-41ac-9bc7-8be9e948afc4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.553085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.554130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.554413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.554680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.559766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.562266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.563697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:19.575916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:19.576974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:19.577895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 283/565] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:19.578371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.588386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.589009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.589284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.589549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.600591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:19.606432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:19.607341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:19.608155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 283/566] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:19.608862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.701254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98b3bf-bb4e-415c-8ba4-c85b8805a162 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.716223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b46cb-5e7f-4697-a9b7-52d9b620c0ea None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.718092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.739816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.740453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.740728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.740995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.741659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.742020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.743378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.752450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 284/567] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.752643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.753208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.753483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.753848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.754516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.754818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.756831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.758377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.778407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 284/568] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.779099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.810999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:19.874565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29f032-d139-445a-9529-f06fd3261f6c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.885255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858cf8-6833-4782-b35b-75b99de09c6b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:19.908686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.909289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.909566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.909870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.910546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.910852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.912300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.919329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:19.919919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:19.920194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:19.920459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:19.921101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:19.921395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:19.922756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:19.923952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 285/569] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.924502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.932055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 285/570] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:19.932804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:19.958708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.023825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.023999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe9349-8770-449e-ae6e-02f1ccd2a98a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.032816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78282991-614e-4064-b0d9-6e7c515d8463 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.058020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.058539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.058819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.059086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.066072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.066682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.066959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.067220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.069272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.070781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.078009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.079415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a55d1058-e7df-45d3-b29b-8b610702371d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:20.084950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.085971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:20.086917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:20.086917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.086917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:20.086917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 286/571] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.087613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2abf-8309-48c6-9feb-2a3e5a527338 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.087613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2abf-8309-48c6-9feb-2a3e5a527338 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.087777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2abf-8309-48c6-9feb-2a3e5a527338 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.089383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 287/572] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:20.089621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2abf-8309-48c6-9feb-2a3e5a527338 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:20.096203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.097252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:20.098176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:20.098176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.098176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:20.098176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.098176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.182496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.195455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2abf-8309-48c6-9feb-2a3e5a527338 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.198511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ecb5f-4e83-4f6b-ba25-4c3ceddaf570 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.229017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.229608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.229922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.230196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.230907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=504b251bfd13480a92e088d0f81d81ff) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:20.231209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.231644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.232256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.232533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.232652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.232803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.237998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/role_assignments?user.id=504b251bfd13480a92e088d0f81d81ff&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:20.238785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.244386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.245891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.249259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-18d46e7b-b631-4b0c-b668-687ffbf156af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:20.263356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.264430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:20.265320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:20.265320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:20.265320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:20.265320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.266548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.266548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.266548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.286103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:20.287818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:20.366231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 288/576] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:20.366986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.393015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e064e3e-3d37-420b-a516-e86214ed4144 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.439192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.439873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.440156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.440431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.441140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:20.441455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.443760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.460179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 289/577] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:20.461079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.483177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.495224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b539e52-7024-4609-be51-0ef3622f746e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.522903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.532967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.533858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.534365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.534846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.535691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:20.536193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.538364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.554787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 289/578] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:20.555928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.600756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7aba2-a893-4af9-8ec1-75fe2349744f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.644845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.645447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.645762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.646029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.647192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:20.648711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.650354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.661564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 290/579] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:20.662988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.674231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bacff1-b20a-4fe9-8400-f3803b32ab13 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.714989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.715802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.716084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.716351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.723852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.725886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:20.738992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.739995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.740960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.754010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.789029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:20.790231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce4b6e-9b28-469a-8da9-8ac419893518 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.838821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.839698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.840124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.840523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.845116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9f5b3-32d5-4cc2-93ac-51cf17bf8143 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:20.849043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:20.851334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:20.867271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.868149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:20.869093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.870313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.886456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:20.887091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:20.887368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:20.887636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:20.897801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:20.903184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:20.904084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:20.904904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 291/582] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:20.905574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:20.983662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b7a97-74e5-46db-9530-59c7a5bafeb1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.010548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a556e9-550c-4d23-bf97-2f8981e84cf1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.013308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.018648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.019247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.019381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.019523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.019796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.027603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.029037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:21.040830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:21.041808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 292/583] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:21.043428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.055462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.056067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.056341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.056664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.057381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.057804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.059221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.078244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.079040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.150155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebe626-42ae-474f-899f-366ae16e863b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.186052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.186773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.187049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.187317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.188006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.188309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.190008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.195159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e673b3-41cc-4d00-8240-9a9aed0d068f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.211754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.211754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.241297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.241847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.242124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.242396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.243042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.243347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.244695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.253762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 293/586] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.254082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.276255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.283218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.326372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e194b-e222-4f46-b3e6-1b01d133db81 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.361974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.362589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.362793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7019-2c89-48cb-a181-1fb87e2a4978 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.362897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.363120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.363828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.364133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.365596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.383761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 294/587] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.384539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.404293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.404911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.405186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.405450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.417265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.419044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:21.432932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:21.433892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:21.434963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:21.434963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.434963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:21.438421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 294/588] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:21.439235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.488556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e4ae1-1ec0-4167-909a-dcd4f4100551 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.501634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.526749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.527404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.527688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.527944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.529692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.543107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=2ce045e8077e433ba889e189fb1c690b, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.544734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.554293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054cccd-b1d4-4586-abcd-d40c20218a46 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.557767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 295/589] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:21 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:21.558648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.605201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.605987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.606264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.606583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.620568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.622104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:21.637791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:21.638910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:21.639798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:21.639798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.639798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:21.643895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 295/590] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:21.644856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.728619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981916-833a-4fab-96d1-59de94825580 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.766086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.766597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.766883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.767158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.774309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691112-262e-4cc3-8b07-69f9e61a7cf2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.780916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.783057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:21.801000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:21.802032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:21.802948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:21.802948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:21.802948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:21.802948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 296/591] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:21.803618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.809913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.816503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.817241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.817821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.818729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.819450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.819945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.821238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:21.821418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.836803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 296/592] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.837956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.929789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87bf59-c948-4a22-a92d-dd966dbeaec2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.950068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a0a6e-88d4-4d9e-aed5-d4d8e55af924 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:21.975069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.975821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.976197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.976585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.977329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.977820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:21.979342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:21.992793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:21.993019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 297/593] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:21.993477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:21.993654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:21.993952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:21.994251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:21.994589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:21.999245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.000783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.014732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 297/594] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:22.015887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.071747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.074232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.105019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23439-f374-42d6-a12c-01f20ea3c8a9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.132447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43066a-896b-4b0a-946b-b9c7dfd19e31 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.142850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.143800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.144277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.144743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.153149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.154785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.167851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.168784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:22.169248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:22.170156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:22.171067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 298/595] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:22.171948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.172226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.172694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.181318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.183215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:22.195641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:22.196587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:22.197533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:22.204212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 298/596] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:22.205234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.296538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eb9a-ba74-4bc0-b735-7d7e6aca89b1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.330195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.331609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f4e-c5e0-4d90-9d1f-211c836e4427 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.344464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.344464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.344752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.345029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.348319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.360689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.362498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:22.374483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:22.375421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:22.376385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:22.380486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 299/597] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:22.381456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.384336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.389831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.390341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.391319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.392289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:22.393196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.395541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.411174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 299/598] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:22.413031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.496068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9316ef-8318-42ea-aa72-ec336cd0df8e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.524814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a8bc3-ec8c-43ad-9525-08f8a7ae87e4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.535358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.535960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.536238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.536509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.537385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:22.537689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.539131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.562016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 300/599] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:22.562016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.564727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.565355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.565635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.565934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.566642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:22.566944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.568980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634cce1-9d8f-45ab-9cb2-0802a690a111 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.581367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 300/600] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:22.582580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372816-685f-4c43-97d2-d4e6da1912a1 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.582862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372816-685f-4c43-97d2-d4e6da1912a1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.583131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372816-685f-4c43-97d2-d4e6da1912a1 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.588895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 301/601] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:22.588895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372816-685f-4c43-97d2-d4e6da1912a1 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.618451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.626098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.680913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30e26a-8b27-4fb1-87ee-60843e0c696a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.698739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372816-685f-4c43-97d2-d4e6da1912a1 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.726560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.727212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.727656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.727934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/57733217d148407dbc9bce988253441e/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.732641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.733253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.733526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.733821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.745142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=57733217d148407dbc9bce988253441e, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.745449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.746732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.746902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bf87b153-f00f-4811-9378-345c229740ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:22.761646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:22.767707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:22.768725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:22.768725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:22.768725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:22.768899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 301/602] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:22 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/57733217d148407dbc9bce988253441e/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:22.768899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.769031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 302/603] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:22.769031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.769031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.769031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.793630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:22.795195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:22.893976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 303/604] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:22.895254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:22.914204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2afe6-4fc7-4169-a597-ef0f0749d6a6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:22.916990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.932304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:22.973772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:22.975118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:22.975838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:22.976109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/039bd7079482417f8fc2727ee1ee1c31/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:22.996662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=039bd7079482417f8fc2727ee1ee1c31, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:22.999048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.017694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 302/605] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:22 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/039bd7079482417f8fc2727ee1ee1c31/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:23.058346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e4dfe-1617-41de-96bd-0dc9d8fb2da7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.114553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.115230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.115517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.115789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.116453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:23.116758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:23.118184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.134350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 304/606] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:23.140140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.275983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ba933-c240-4707-8d3a-3d5fd2999f1a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.287119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.319593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.320618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.321132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.321605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.331573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:23.333274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:23.349711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:23.350665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:23.351550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:23.354450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 303/607] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:23.361662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.373689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:23.378225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:23.412666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976ae7-f811-45a9-bfe2-854a9ef1643b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.456676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.457598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.458058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.458910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.473064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:23.481107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:23.482281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:23.483424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:23.484140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce671a46-00ce-4605-a367-a87c81c2a93b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.486030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 305/608] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:23.492484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.557551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.558106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.558383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.558653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.559348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:23.559656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:23.561079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.590546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 304/609] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:23.596160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.664610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3637c1-6c36-4d25-ac74-fb4b9df67e3d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.696217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:23.705319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.706181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.706711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.707146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.707965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:23.708491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:23.710086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.723810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 306/610] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:23.725341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.792784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:23.841070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02195-80f6-48e8-bd80-a7d80bcaead0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.878036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.878967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.879413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.879831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:23.893972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:23.895791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:23.900382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c617-4cd7-45bc-8a32-56ad8cde55b0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:23.914170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:23.915396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:23.916496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:23.916496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:23.916496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:23.922803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 307/611] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:23.924324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:23.974978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:23.991110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:23.991637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:23.991917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:23.992190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/ac90a40ddbfb4c79bc6941adb9498146/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.015151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=ac90a40ddbfb4c79bc6941adb9498146, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:24.016687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a0a5b-618b-4c74-9f2e-9517e3f886f5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:24.033827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 305/612] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:23 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/ac90a40ddbfb4c79bc6941adb9498146/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:24.035605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7869-0550-4e65-9246-c68749310d4b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.036025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7869-0550-4e65-9246-c68749310d4b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.036428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b7869-0550-4e65-9246-c68749310d4b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.039072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f4fb7-6b3d-4a51-a94c-005fb182a5a7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:24.041827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 306/613] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:24.045517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.050465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.050901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.070573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:24.071787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:24.104302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:24.105437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.105936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.106351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.107189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:24.107687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:24.109113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:24.146885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 308/614] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:24.150686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:24.192278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 307/615] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:24.311167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7668a-1579-4696-9bd8-251310ef7711 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:24.319283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:24.347038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:24.347666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.347943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.348213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.356360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:24.357769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:24.370020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:24.371031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:24.372253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 309/616] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:24.378702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:24.462904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:24.534683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983960-d1c0-452d-bb91-f86dd2b43484 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:24.579795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:24.580393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.580675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.580931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.581650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:24.581980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:24.583393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:24.601896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 308/617] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:24.611111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:24.735923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:24.785213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b097d-873e-48c5-8b70-bba3346985ea None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:24.867478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:24.868506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.869013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.869474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.890241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:24.891346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c911ba5-319d-42fe-a3e7-570bc55e3dfc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:24.892331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:24.911901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:24.923314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:24.924289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:24.925162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:24.925162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:24.925162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:24.932048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 310/618] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:24.937346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:24.966798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:24.968119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:24.968904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:24.969705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:24.978056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:24.994154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:25.000242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:25.001314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:25.002196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:25.008192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 309/619] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:25.016537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.125544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b902e-88a7-4857-af57-4939b0a29327 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.166822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.168465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.168956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.169486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.170427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:25.171943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.173549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.195716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 311/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:25.202093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.223632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e72d-89eb-4e17-9e20-85b63d62a5d6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.261361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.262346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.262820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.263283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.264123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:25.264630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.266241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.276201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 310/621] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:25.282146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.315528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:25.349770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:25.395231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c47cbe-2125-4c92-a3b7-f1b09c48c145 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.399368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c5b6-658a-45d2-a952-6eb1c18cf554 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.445860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.446516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.446792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.447061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.458208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.459435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.459712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.459982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.471424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.472934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.474178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.475633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:25.497102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:25.498134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:25.499022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:25.503538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:25.504660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:25.507452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:25.507452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:25.507452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:25.507939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 312/622] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:25.508089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:25.510304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.510562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.612849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:25.631324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d0021-a7c3-4cf9-a394-09e8c6cfe6fb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.632856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9016-7c8c-4dcb-b4db-9f8824bf7b6c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.666379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.666900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.667184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.667455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.668138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:25.668445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.669256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.669888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75636eba-a7e3-4e06-b7c3-c2e3f5c0700a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.670006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.670197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.670431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.671067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:25.671374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.672708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.677450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:25.684949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 313/624] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:25.684949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd13a1-28a1-479f-9614-b5c514fbcef7 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.684949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd13a1-28a1-479f-9614-b5c514fbcef7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.684949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd13a1-28a1-479f-9614-b5c514fbcef7 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.686284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 314/625] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:25.687544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348f3e-ebcf-46c4-96f1-d4b7f548afc6 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.687731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348f3e-ebcf-46c4-96f1-d4b7f548afc6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.688007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348f3e-ebcf-46c4-96f1-d4b7f548afc6 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.690415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:25.691251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.697949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 315/627] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:25.697949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a2014-7101-4943-91f5-3179eaea483f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.697949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a2014-7101-4943-91f5-3179eaea483f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.697949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a2014-7101-4943-91f5-3179eaea483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.721379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-417a2014-7101-4943-91f5-3179eaea483f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:25.722589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-417a2014-7101-4943-91f5-3179eaea483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:25.797957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 316/628] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:25.799193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.799483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.799755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.809509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6dc24-05f8-4d7d-a4e5-fe04466da2e3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:25.819283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:25.820587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:25.851016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:25.852046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:25.852525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:25.853280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/504b251bfd13480a92e088d0f81d81ff/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:25.866947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:25.871006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=504b251bfd13480a92e088d0f81d81ff, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:25.872781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:25.897895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 313/629] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:25 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/504b251bfd13480a92e088d0f81d81ff/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:25.897895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:25.933186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 317/630] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:26.033191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0dc6-dcfd-40eb-9b5d-43bcb8c826e4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.077925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.084593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.085626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.086134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.086753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.095583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.097435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:26.112187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:26.113205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:26.114210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:26.117882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 314/631] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:26.126982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.183612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.208515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.235143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cec7ba-17b1-41b9-99ac-4e7d7a5d3721 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.272773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09811c-ec02-4441-bb63-b37eb268f1a6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.277896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.278596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.278876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.279146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.293824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:26.301107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:26.302052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:26.303740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 318/632] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:26.311352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.315975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.316576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.316847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.317110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.317909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:26.318218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.319624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.340008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 315/633] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:26.340961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.432229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c9cd4-d6b2-442d-acb8-03b3a4faa89a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.457401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.472990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deddae-2cae-4a2f-99ec-b74f0c0b0f97 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.480549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.481865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.482151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.482424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.483098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:26.484074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.485802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.486939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.498973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 319/634] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:26.499821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.517286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.518239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.518580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.518913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.530700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:26.535856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:26.538775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 316/635] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:26.540870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.636589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b75ba6-2cb0-4a21-a648-24c2de885283 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.658212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94faba7-58a2-46c0-9dc2-2810d6e6ddee None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.673652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.674284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.674558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.674830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.698592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.699217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.699494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.699757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.711018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.712681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.726362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:26.729037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:26.730392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:26.731855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:26.731855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:26.731855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:26.735091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 317/636] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:26.735745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.747727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.749163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dccb8-2c2c-490e-8d71-475993f384fa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.764515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.848889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd09d-b4d0-41cc-9185-bf6ff34ee81b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:26.855985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 320/637] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:26.857321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407dae-dd38-4a8d-8818-fad35adb99f7 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.857604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407dae-dd38-4a8d-8818-fad35adb99f7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.857897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407dae-dd38-4a8d-8818-fad35adb99f7 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.861770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 321/638] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:26.861770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407dae-dd38-4a8d-8818-fad35adb99f7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.891195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:26.891931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:26.892208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:26.892477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:26.893129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:26.893424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:26.894856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:26.908166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 318/639] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:26.908166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:26.950274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:26.973108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407dae-dd38-4a8d-8818-fad35adb99f7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.000311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.011619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.012387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.012814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.013122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.013874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:27.014245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.015666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b51030-7779-4e3b-bf78-a96e108c88d5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.019344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25782567-913b-4c79-85d1-6a8feccd9206 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.027853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 322/640] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:27.029134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.029530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.029972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.047023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:27.048337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:27.059181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.059805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.060080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.060356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.073002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.074640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:27.089530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.090691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:27.091771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:27.091771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:27.091771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:27.095139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 319/641] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.095944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.117916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 323/642] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:27.118738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.198185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.206121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ce279-fbe7-4b11-8259-7b2b52147504 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.239414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2df6-34ef-4cf9-bdb7-ca49074e1082 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.242309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.243441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.243441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.243441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.246276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.256359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.257895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:27.273443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.275369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:27.276697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:27.276697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:27.276697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:27.278095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 320/643] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.278934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.289761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.291796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.292273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.293103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.304043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.306201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:27.320947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.322030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:24:27.323058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:27.325952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 324/644] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.327408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.389592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911858dc-2201-4c46-9518-4aa498bbc039 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.425092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.425696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.426004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.426275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.426914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:27.427719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.429084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.440764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 321/645] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:27.441549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.452930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16476b9f-f668-4a14-b11e-9b8becf8d395 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.482668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.490675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.491276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.491546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.491819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.492055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.492452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:27.492805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.494250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.507516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 325/646] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:27.511985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.550420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea99ee-4cf2-4a15-907e-2309cb78ee26 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.586662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.587266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.587543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.587813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.588535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:27.588836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.590284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.608186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 322/647] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:27.613244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.619824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e56c-d713-4075-a14a-d6263195f8f5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.662107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.662888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.663171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.663441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.674079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:27.679272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.680179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:27.681025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:27.685857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 326/648] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.686364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.722846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ae6af-8084-47ed-8de7-20d4fa16e544 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.731733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.742107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.763126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.764065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.765047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.765047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.772060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.773917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:27.787350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.788269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 323/649] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.789154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.800963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f164978-5527-486e-9a57-74343afc75ef None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.835729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.836509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.836786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.837431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.844929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:27.846402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:27.858517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:27.859475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 327/650] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:27.860439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:27.896731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809dbd-f27e-4d37-8d50-35752ce25908 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.931561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:27.932163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:27.932440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:27.932700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:27.962338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1cfaf-f054-4f58-a331-8d37ed659f5b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:27.966038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.973364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:27.999456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.000047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.000394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.000669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.001322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.001619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.001749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.003023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.003319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.011051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 328/651] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.011840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.114072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a2fa-6959-47f1-8e21-274c292dc7a0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.114298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 324/652] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:28.115344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.147658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.148258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.148618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.148888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.149565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.150161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.151572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.168523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 329/653] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.168523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.189706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.198135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.230736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db6f7-5c54-4d51-a0c4-e9ae2d700e70 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.265360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.265915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.266189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.266455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.267168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.267463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.267822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9971-78bb-43d4-89dc-43dc71267c90 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.268862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.292577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 325/654] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.292577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.307115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.307747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.308027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.308299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.318487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.319954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:28.334580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:28.335525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:28.341222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:28.341222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:28.341222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:28.341222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 330/655] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:28.341222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.387616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a282b7-d061-4580-a8c9-4696f7986307 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.410396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.421657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.422308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.422581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.422852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.423043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.432687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.434162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.438981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5ee6-43c8-4046-b829-bdf47cebeeab None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:28.448582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:28.449719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:28.450658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:28.450658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:28.450658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:28.450658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 326/656] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:28.450893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.473806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.474422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.474699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.474968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.475671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.475977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.477385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cc9b9-f340-489d-add5-6dc637130304 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.483069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 331/657] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.484242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abd866-5c1e-408a-8a17-0e9b6aa46f91 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.484527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abd866-5c1e-408a-8a17-0e9b6aa46f91 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.484797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abd866-5c1e-408a-8a17-0e9b6aa46f91 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.486141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 332/658] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:28.486748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abd866-5c1e-408a-8a17-0e9b6aa46f91 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.566648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b9282-3b05-40ca-868d-31bb4c3fe761 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.607371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abd866-5c1e-408a-8a17-0e9b6aa46f91 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.610027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.610800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.611189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.611467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.646595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.647209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.647483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.647770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.648392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.648688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.650340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.663036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.664661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 333/659] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.665600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.678395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.694188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.695828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6423a-d31c-469b-aa02-a641a365ebd7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.787894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b01b5-ef99-40b4-ae51-4f0c7713a744 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:28.809613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 327/660] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:28.809613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.809613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.809613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.826027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:28.827120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:28.828752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:28.829355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:28.829631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:28.829933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:28.830557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:28.830864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:28.832212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:28.843414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 334/661] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:28.844208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.913766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 328/662] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:28.913766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:28.920246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.924780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:28.969132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4868a4-decf-411f-98fc-ed9bda29d1c4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.017419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.018694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.019393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.019868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.026817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977b3b-5325-46f2-ae15-cbda3d622ff3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.034979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.036446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:29.050902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:29.052017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:29.053660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 335/663] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:29.054900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.065253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.065916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.066196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.066467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.077386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.078807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:29.093661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:29.094818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:29.095790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:29.095790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:29.095790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:29.095790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 329/664] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:29.095790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.154710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.173289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cb166-ce41-4d53-a2e3-4b478d3d7d51 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.197017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a30fb-767b-4e6d-9f82-851a7f546cdf None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.202171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.214389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.215338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.215619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.215891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.223813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.225843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.232606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.233205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.233484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.233778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.234499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:29.234859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.236291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:29.236986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:29.237868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 336/665] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:29.242766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.258145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 330/666] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:29.259148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.364306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaed032-e94a-4960-a2b2-511ff50ff521 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.381842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ab22b-244f-40ad-8143-355a250e0f28 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.398484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.408742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.409537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.409991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.410413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.411197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:29.412197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.413696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.417313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.417965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.418245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.418517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.426779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 337/667] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:29.428319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.433037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:29.437875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:29.438987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:29.440039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:29.443809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 331/668] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:29.444565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.488457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.546312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c1f6-2253-4566-bf56-981b6d078a44 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.549691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26986d-281b-4ef9-9fbb-d370ca754388 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.582563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.583161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.583962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.584237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.584481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.584918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:29.585086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.585238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.585384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.585618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.586655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.603380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 338/669] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:29.603380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.643705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.670980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.672938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.713209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcd419-4a8f-46e6-9c59-c1886cc64a9d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.722483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.749396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.750040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.750317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.750585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.757215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.758652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:29.769608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:29.770690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:29.773015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:29.776842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 339/670] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:29.777703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.790028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 332/671] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:29.790028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.866696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:29.890145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9a7b0-00dd-49d6-a01e-cc00b0bbf5c1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.890379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bed77-e2fb-4826-a2fd-c4e7598c7ac2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:29.926917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.927540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.927880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.927987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:29.928252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.928508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:29.928784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:29.929052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:29.929151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:29.929468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.929776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=57733217d148407dbc9bce988253441e) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:29.930081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:29.931035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.931485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:29.944371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 333/672] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/role_assignments?user.id=57733217d148407dbc9bce988253441e&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:29.944371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.944639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 340/673] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:29.944639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:29.979082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.063182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8e9bd-40e1-4e3a-a45a-f3802ef9acd9 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.090238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bb654-85cc-4aae-af50-2be2f319ad36 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.103915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.105347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.105856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.106575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.122008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.124076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.134246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.134994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.135366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.136226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.137024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:30.137697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.139235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:30.142978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:30.144087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:30.151896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:30.151896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:30.151896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:30.151896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 341/674] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:30.151896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.155828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.159024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 334/675] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:30.160094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.245305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.273405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff4661-b8e3-4e68-a625-fa2d1b5b3aaf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.288942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5347-e2d9-4906-ab7c-97639c543b52 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.327161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.327588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.327764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.328095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.328364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.328846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.329000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:30.329300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.329552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.330001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.330916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.343485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 335/676] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:30.348065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.350073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.351541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:30.373412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:30.375033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:30.376123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:30.376123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:30.376123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:30.378616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 342/677] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:30.379608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.417918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.466823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48a2a9-dd58-47cd-86ad-159b2f2a128c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.502285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.502972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.503318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.503699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.504518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=039bd7079482417f8fc2727ee1ee1c31) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:30.504923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.507110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.518074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 336/678] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/role_assignments?user.id=039bd7079482417f8fc2727ee1ee1c31&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:30.518074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.531735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceb071-1427-49ad-80e2-f1ff0a7804fa None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.611622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.612752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.613203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.614105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.616943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.633210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.635747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:30.662440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:30.663423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:30.664324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:30.671433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 343/679] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:30.678305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.705776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99204b-88d2-4055-8d04-961725b9a281 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.757095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:30.774193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.774810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.775347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.775618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.776271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:30.776576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.778135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2ed1-ffd1-4819-9855-8694805eeb8e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.791770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 337/680] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:30.793038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bf8a-f18d-4eff-bfe2-aa8fc0d7a5f5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.793323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bf8a-f18d-4eff-bfe2-aa8fc0d7a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.793596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4bf8a-f18d-4eff-bfe2-aa8fc0d7a5f5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.795063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 338/681] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:30.802698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.803043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.803244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.823612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:30.824809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:30.836283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6b495-9c45-4c25-a0e8-44cd406f0f32 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:30.879187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:30.880227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:30.880800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:30.881272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:30.882205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:30.882713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:30.884908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:30.899695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 344/682] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:30.901044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:30.908033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 339/683] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:30.909165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.002954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.076189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64894039-08de-45b1-9e1c-b881cb82937c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.115963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8ff77-d091-4a0b-9741-782d001d0d9a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.145105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.146253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.146557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.146824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.148590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.163970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:31.165422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:31.179136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:31.180114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:31.181051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:31.185173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 345/684] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:31.186499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.209062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.209724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.210115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.210400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.211127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=ac90a40ddbfb4c79bc6941adb9498146) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:31.211434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:31.212963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:31.225953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 340/685] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:30 2022] GET /identity/v3/role_assignments?user.id=ac90a40ddbfb4c79bc6941adb9498146&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:31.226932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.302528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2f57-3da8-4f27-8eef-c13de31dfb50 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.326414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.346664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.347217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.347667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.348261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.349836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:31.350153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:31.351889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:31.394112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 346/686] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:31.398461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.474667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa6e05-aa10-48e2-86a2-ba72dff92138 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.526567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.527343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.528100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.528650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.530265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498dee-55ce-4ee5-a4ff-55449b9b597e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.541102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:31.547732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:31.548632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:31.549460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:31.550117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 341/687] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:31.555018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.572030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.572646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.573186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.573461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.601853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.632011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.670009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:31.670479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7835-f236-4f8a-92a7-dfb472264f7b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:31.671948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:31.728907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:31.729513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:31.729821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:31.730092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:31.730860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:31.731165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:31.732565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:31.741830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 342/688] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:31.748224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.876250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 347/689] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:31.883182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:31.931799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:31.936489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316c8d1-a107-4387-b13e-5468076c9da3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.000693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.002656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.003606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.003875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.004700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.024692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.026425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:32.051830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:32.053409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:32.054327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:32.054327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:32.054327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:32.054725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 343/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:32.061693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd4a9-23f5-4d41-b6d3-de34b48bdd5b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.064421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.144212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.144800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.145077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.145341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.168298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.170721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:32.198223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:32.199228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:32.200821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:32.200821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:32.200821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:32.200821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 348/691] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:32.207143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.224385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553c8bd-5058-44e6-a060-42e8023eebc7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.264763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.265365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.266223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.266512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.267152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:32.267452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.268854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.283898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 344/692] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:32.289372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.304880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.417936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0f5a-f28a-482b-9436-0dc03303ef53 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.434136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76058c9d-f8f2-43cd-8167-94398f9d8b38 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.454366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.455378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.455732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.456068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.465487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.466543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.468514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.479321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.480133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.480581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.481139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.482018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:32.482460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.483946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce886c-1756-4268-8c21-650f336c6f2e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-fdf8fbf3-269f-4ef5-8ff7-dfa95dee3a8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:32.484379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:32.485470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:32.486649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 345/693] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a7e3-d019-4e07-88ae-f677aaa10fd9 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a7e3-d019-4e07-88ae-f677aaa10fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324a7e3-d019-4e07-88ae-f677aaa10fd9 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 346/694] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:32.493751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a7e3-d019-4e07-88ae-f677aaa10fd9 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.511584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 349/695] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:32.513388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.513889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.514352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.537678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:32.538998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:32.592682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.617764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 350/696] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:32.617764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.645751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324a7e3-d019-4e07-88ae-f677aaa10fd9 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.714747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.715679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.716218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.716692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.717607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:32.718282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.719884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.741162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 347/697] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:32.747178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:32.855052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a887a42-eac7-46fc-abc9-5d7d0440ec48 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.890294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1506d-2fe2-4994-839d-a622c819a555 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:32.891428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.892447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.892975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.893438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.895212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.927991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:32.964486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:32.965131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:32.965411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:32.965685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:32.973824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.975271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.975402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:32.976899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:32.989144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:32.990150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:32.991025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:32.995695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 351/698] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:32.996845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.083884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 348/699] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 15:24:33.085628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.115059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e0e2-c064-45e7-93d6-131ed4d3e023 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.117596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.154691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.155394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.155739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.156005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.156577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.157944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-093564b2-9a16-447e-a45b-dad5f1890084 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:33.168662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:33.169716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:33.170595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 352/700] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 15:24:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:33.171402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfb9-f746-460d-9f37-5ba51731cac6 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.171402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfb9-f746-460d-9f37-5ba51731cac6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.171524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacfb9-f746-460d-9f37-5ba51731cac6 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.172831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 353/701] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:33.173358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacfb9-f746-460d-9f37-5ba51731cac6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.199406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81bcc4-a6ec-4a15-95ad-56a243d1e215 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.214088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.237823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.239018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.239637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.240093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.240974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:33.241461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.243179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.260561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 349/702] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:33.260561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.278133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacfb9-f746-460d-9f37-5ba51731cac6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.315829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.316435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.316706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.316968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.327734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.329202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-7611d904-206b-40d8-be8b-e8b57cde0a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:33.345241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:33.346258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:33.347177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:33.347177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:33.347177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:33.347177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 354/703] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:33.347817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.348046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.348367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.354723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.366725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297be8-5c0d-4c6f-9f56-339c593808ff None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.367888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:33.369639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:33.402490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.403098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.403377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.403639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.404252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:33.404551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.405932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.410340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 350/704] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:33.411087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.443535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 355/705] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:33.444191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.466355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.546659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762987ae-89a9-48c6-b0b4-b2e70eeb8f6b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.554991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1da06-79af-4c3d-a167-f904b85c3d61 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.587469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.588040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.588316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.588588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.589305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=504b251bfd13480a92e088d0f81d81ff) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:33.589608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.591227 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.601767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 351/706] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/role_assignments?user.id=504b251bfd13480a92e088d0f81d81ff&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:33.601767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.609690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.610586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.611359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.616364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.617298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:33.617767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.619387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.641857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 356/707] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:33.644383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.651420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.793876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:33.795874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24208b-5843-43d7-97d6-f52bbfee6e3b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.827562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946b034-2660-47c3-96e7-49f6b02c8188 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:33.846715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.848692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.849693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.850247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.851645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:33.852189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.853841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.860936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 352/708] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:33.862243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:33.878722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:33.879376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.881673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.882020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.892988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:33.894510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-16dfccd9-11af-44d9-94d3-dd58b2e66fa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:33.913409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:33.914456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 357/709] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c9a6-af44-406e-8e83-a728c53cc03c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:33.916454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c9a6-af44-406e-8e83-a728c53cc03c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:33.917051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278c9a6-af44-406e-8e83-a728c53cc03c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:33.919179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 358/710] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:33.920129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278c9a6-af44-406e-8e83-a728c53cc03c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.004116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.033548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdcdd7-3329-4a79-86d8-31b21495e7bc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.065245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278c9a6-af44-406e-8e83-a728c53cc03c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.074793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.075855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.076309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.076785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.090200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.092110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-4f390d45-500d-4ef6-ac92-3493c12ebabd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:34.107657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:34.108759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:34.109713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:34.109713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:34.109713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:34.110908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 353/711] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:34.112820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.114273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.114582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.119545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.120155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.120427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.120693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.121380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:34.121676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.123105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.134317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.139878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 359/712] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:34.141868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.143995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:34.146649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:34.227396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 354/713] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:34.228575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.255195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0265c-c7df-4803-8cbe-83c9a8b95f51 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.313974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.314845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.315118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.315384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.316036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:34.316330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.317752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.318381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.344887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 360/714] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:34.353983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.375513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6ed6f-8169-42df-b0ce-8592481e68a9 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.449504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.465665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.466309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.466582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.466853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.467572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:34.467876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.469313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.483902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 355/715] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:34 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:34.495593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01922328-8224-49d0-afbf-a0522ba49ade None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.541513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.542163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.542440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.542773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.543422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.544985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.569672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.581634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 361/716] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:24:34 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:24:34.700182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2b7e-5d05-4889-bf77-f84b49f285fc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.735024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.744096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.744742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.745014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.745281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] PATH_INFO: `/v3/services/network` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.745898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.747297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:34.760015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:34.761056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:34.761918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:34 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:34.767439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:34.908157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6847b-24ad-4e56-ab58-70f235b05a07 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:34.925040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:34.951405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:34.951946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:34.952222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:34.952490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:34.953132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] RBAC: Adding query filter params (name=network) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:34.953434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:34.954973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a454c-01b3-4c85-b457-944cd601d894 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:34.961878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:34.967199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:35.075674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203cf30-71ae-40e4-8e03-8e859fb1f505 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:35.118597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:35.119201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:35.119474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:35.119743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:35.120370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] RBAC: Adding query filter params (type=network) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:35.120669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:35.122058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7397ba2-0eaf-4835-9dfc-4a3678bc925a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:35.126710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 357/719] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:36.397147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23431ed-9ed6-46b1-b755-ab524d83f05c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:36.398217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23431ed-9ed6-46b1-b755-ab524d83f05c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:36.398706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23431ed-9ed6-46b1-b755-ab524d83f05c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:36.400773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 363/720] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:36.406354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:36.407207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:36.407688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:36.415164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8279-6f8d-4142-b47a-e8c2ea34f611 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:36.415705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8279-6f8d-4142-b47a-e8c2ea34f611 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:36.416182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8279-6f8d-4142-b47a-e8c2ea34f611 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:36.418038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 364/721] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:36.422665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:36.423170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:36.423693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:36.452697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:36.454014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:36.455438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:36.456820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:36.542203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:36.573836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 358/722] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:36.601284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 365/723] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:24:36.903924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:36.914939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.094221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe2f2-e704-4866-91cf-8d30964cb801 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.097583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b38f-7cf2-4dc8-b49d-575351b57d35 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.119378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.144193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.145132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.146166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.146652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.147981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:37.149852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c0404-2239-4785-9c1a-c55343113844 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:37.172803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.173863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.174380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.174876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.178449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 359/724] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:24:36 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:37.179930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf68-84a5-4f50-a06f-f2412fded8b5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.180614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf68-84a5-4f50-a06f-f2412fded8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.181346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf68-84a5-4f50-a06f-f2412fded8b5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.183697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 360/725] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:37.189692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.190126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.190425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:37.190577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:37.196110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:37.197429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:37.198505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:37.201285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 366/726] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:37.208638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.218789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:37.220830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:37.309838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.385924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 361/727] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:24:37.397165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee9695-80f2-4569-a9f7-e101c5009b02 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.445364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.446071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.446346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.446655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.447319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:37.447629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:37.448968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372df72f-c4a9-472d-9427-40ea0cf2b64d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:37.461995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 367/728] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:37.467803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.585964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c51be3-3b76-4924-9b20-4ab6801d6804 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.606769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46b9c-da78-4a02-ae16-0d91009d960f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.607089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46b9c-da78-4a02-ae16-0d91009d960f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.607313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c46b9c-da78-4a02-ae16-0d91009d960f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.608901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 368/729] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:37.613816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.614100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.614942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.624574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.625191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.625461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.625744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.641486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:37.642078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:37.642943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:37.643253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:37.665045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:37.666232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:37.667173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:37.667173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:37.667173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:37.667173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 362/730] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:37.673705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.674707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.704363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.745181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 369/731] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 15:24:37.746143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.795649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e07c1-084e-4c0c-b1dc-439ac456bb7a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.830585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.831577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.832084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.832575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.833991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:37.834512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:37.836093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:37.853497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 363/732] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:37.854367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d2b63-d9f3-46d3-bdce-2e60c45bc53c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:37.855292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.891737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:37.892382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:37.892656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:37.892923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:37.906262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:37.912098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:37.914373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:37.916376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 370/733] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:37.919629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:37.948594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.964498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:37.983495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4aab0-36f5-4aa9-ba02-de3831a0d418 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.019248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.020277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.021299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.021809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.038271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.041174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:38.059014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:38.060017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:38.060996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:38.068195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 364/734] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:38.073940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.084182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb5773-1b1d-4138-8cf6-8cef71b9156a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.137959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.138563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.138841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.139109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.139764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:38.140061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.141821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064ec6b-9bca-4466-8f1c-8e04e49ee625 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.151828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 371/735] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:38.153204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8da39-e17e-4d71-a42c-4b90438838a9 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.153486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8da39-e17e-4d71-a42c-4b90438838a9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.153768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8da39-e17e-4d71-a42c-4b90438838a9 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.156763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 372/736] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:38.157885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8da39-e17e-4d71-a42c-4b90438838a9 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.201317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132595b3-51e4-4df4-8573-9f5fb0bbb489 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.236731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.237334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.237614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.237918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.238645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:38.238951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.240402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.249045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.259496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 365/737] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:38.260324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.263233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.273696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8da39-e17e-4d71-a42c-4b90438838a9 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.311187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.311812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.312093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.312364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.323673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-acec48a9-ded2-488d-9206-ca66087adace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:38.328394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:38.329358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 373/738] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:38.331029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.331776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.331776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.351434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:38.352689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:38.372241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f6c6-bab8-45a0-b29a-248b7e6f8bec None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.408748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.409385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.409663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.409958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.420422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.421857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.424502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 374/739] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 15:24:38.425418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:38.451350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:38.452334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:38.453218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:38.453218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:38.453218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:38.459810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 366/740] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:38.459810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.522767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.527922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.555241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120856-4bb1-456d-8d33-fbd74d0f4bf3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.597023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b14dd-9ccc-4814-8e63-36477cafb2ed None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.600346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.601224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.601779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.602270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.632737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.633337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.633615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.633931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.634576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:38.634878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.636294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.649014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 367/741] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:38.649901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.698117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.699957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.760421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b1cb7-52c3-4f25-806a-c319421fcc43 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.776451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.777342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:38.797294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.797927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.798209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.798478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.799116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:38.799434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.800779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.806655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 375/742] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 15:24:38.807395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.817422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 368/743] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:38.822814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.909806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951d90c-fac7-4eff-9fff-412b420798c3 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.921400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3ca1-b29e-4a5d-912c-048d15a672c3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:38.948365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.948921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.949200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.949472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.955294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:38.955896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:38.956172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:38.956446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:38.957090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.958813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.959931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:38.961513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:38.977862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 369/744] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:24:38 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:38.977862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:38.978139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:38.979362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:38.980265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:38.980265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:38.980265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:38.983415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 376/745] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:38.984804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.028029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.046170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.131611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37e0f6-f020-4194-a40d-be0d74659586 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.210516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6107b94-93d1-4bc2-a2a9-f071748c27aa None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.211458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.212333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.212829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.214685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.232386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.234214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:39.249213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:39.250295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:39.251237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:39.251773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 377/746] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:39.252613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.267133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.268021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.268608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.268608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.296248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.297776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:39.320559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:39.321661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:39.322614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:39.322614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:39.322614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:39.322614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 370/747] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:39.323696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.370650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.391060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c07e-af6f-4078-b493-41e6dd53d575 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.457757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.457757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.457757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.457757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.459486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:39.459486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.465828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.489760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 378/748] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:39.489760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.505760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.541760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ffef0-368f-456a-9d29-37a6b6608034 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.586006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.586643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.586924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.587194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.588443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:39.588756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.590996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.614782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 371/749] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:39.615635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.645334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aecff-f0fb-4cb3-81d4-ea3e7ed35fca None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.683605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.684218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.684494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.684762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.685398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:39.685699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.687096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.709198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 379/750] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:39.709198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.717335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.740510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad756-f4c2-47c2-9a14-e1fbd4ca0f3a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.777110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b142982-e898-495c-9510-5f734f30931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.777813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142982-e898-495c-9510-5f734f30931f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.778044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142982-e898-495c-9510-5f734f30931f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.778311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b142982-e898-495c-9510-5f734f30931f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.785387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b142982-e898-495c-9510-5f734f30931f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.786888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b142982-e898-495c-9510-5f734f30931f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7b142982-e898-495c-9510-5f734f30931f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:39.798337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:39.799339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:39.800307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 372/751] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:39.801278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712c91-230d-4bb2-86d7-ab5891f47a54 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.801278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712c91-230d-4bb2-86d7-ab5891f47a54 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.801278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1712c91-230d-4bb2-86d7-ab5891f47a54 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.802614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 373/752] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:39.803322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1712c91-230d-4bb2-86d7-ab5891f47a54 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.813367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.825712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af45ed-fade-477a-9241-37d8ec09b9ee None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.869111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.870076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.870355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.870623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.882530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.883965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:39.899552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:39.901234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:39.903012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:39.903012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:39.903012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:39.906610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 380/753] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:39.907270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:39.924786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1712c91-230d-4bb2-86d7-ab5891f47a54 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:39.960679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:39.961299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.961571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.961869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:39.966905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:39.968760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:39.970144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-1cc73edf-028e-4cf5-9872-7fcc65338997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:39.981259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:39.982213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:39.983134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:39.987333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 374/754] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:39.988435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:39.988714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:39.988986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.007114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:40.008336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:40.012628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fb32-eaa4-4f48-a24a-a0dba772f6cd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.051629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.052830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.053101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.053361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.054137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:40.054687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.055843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.070530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.080057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 381/755] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:24:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:40.080057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.085910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 375/756] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:40.089781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.190508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3af55b-d9c0-4ba7-8db6-393e77e7e58a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.210554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.220748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff720be-ec65-44a1-ad96-a977d19265b9 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.234739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.235550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.235981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.236434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.237371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:40.237979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.239982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.253176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 382/757] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:40.254394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.259278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.259665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.260044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.260406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.261190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:40.261587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.263134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.284098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 376/758] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:40.284098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.335654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.373938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67f11-b10d-4194-8145-459cb9a70046 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.387080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145925a-12b7-4999-8b5a-bae192fa11bf None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.412846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.413684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.414165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.414597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.423760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.424390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.424667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.424934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.432883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.434365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:40.446059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:40.447136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:40.448034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 377/759] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:40.448520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.467647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.492235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.493611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.558462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ccf34-c76d-45bd-8e0c-1904469cd939 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.570779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.598150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.599424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.599705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.600019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.600753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=504b251bfd13480a92e088d0f81d81ff) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:40.601062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.606383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 383/760] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:24:40.606383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.606594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.610810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 378/761] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/role_assignments?user.id=504b251bfd13480a92e088d0f81d81ff&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:40.617812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.701584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.724087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6838-0d8d-4384-b91f-e73a07f1620c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.731419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0d9c9-3d83-41e1-bb96-830c693c1454 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.763805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.764876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.765430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.765934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.766773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:40.767221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.769050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.774052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.775347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.775839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.776317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.777148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.778932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:40.789806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:40.790906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:40.791777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:40.792534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 379/762] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:40.792534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.796722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 384/763] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:40.797895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.838606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.911571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e12f2-223e-4012-891b-9ccb26fd11cd None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.933539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bb3b-467e-4fb3-b6fb-6aa8e7492fdb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:40.947587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.948428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.948811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.949176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.960228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.962819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.973256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:40.974385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:40.974667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:40.975085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:40.977165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=2ce045e8077e433ba889e189fb1c690b, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:40.978627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:40.980533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:40.981452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:40.982372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:40.982372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:40.982372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:40.985874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 380/764] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:40.986706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:40.994861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:40.999678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 385/765] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:40 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:41.000662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.174947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:41.190313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b0a4c-521d-47fe-b9e9-cd89f47e9d50 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.198651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b947fe-0d8b-4544-81d2-77e4ba9a4fd6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.239280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.240396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.240673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.240942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.241586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:41.241910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.243302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.246059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.246686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.246957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.247220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.248130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:41.248241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.249634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.255235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 381/766] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.264361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 386/767] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.265758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.272788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.365886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:41.422532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8aae4-ff4d-4191-9cc5-302d2b008ecf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.430152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051c052-70e1-4fe8-814a-53a4c719ede0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.463819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.464453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.464732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.465005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.465454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.466247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.466578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.466903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.467532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:41.467832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.469188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74fd8c-8a6e-4f33-b8b8-c0a81b7aee3c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.472827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.474828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.475204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 382/768] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.481335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bdb9-e67e-40fa-8645-be0c39f14ccf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.481620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bdb9-e67e-40fa-8645-be0c39f14ccf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.481915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383bdb9-e67e-40fa-8645-be0c39f14ccf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.483446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 383/769] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:41.484142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383bdb9-e67e-40fa-8645-be0c39f14ccf None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1c29608a-3088-41eb-a4fa-b6fd4b79765e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:41.495673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:41.496617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:41.497532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 387/770] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:41.498530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.498688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.498870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.515144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:41.525956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:41.528839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:41.612421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383bdb9-e67e-40fa-8645-be0c39f14ccf None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.617863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 388/771] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:41.618925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.687546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.688912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.689491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.691729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.692795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] RBAC: Adding query filter params (interface=public, service_id=11fac2b5948345e59f847dabe5bff29f, region_id=RegionOne) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:41.693256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.695802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.712041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 384/772] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/endpoints?service_id=11fac2b5948345e59f847dabe5bff29f&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.718206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.729628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:41.819870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bda55-7c28-4457-9112-6a8910bcddd6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.862148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:41.885858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.886473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.886747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.887016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.887702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:41.887999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.889656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.896077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cb9c8-e144-456f-a269-b6bb34b0d3ea None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:41.922143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 389/773] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.929043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:41.965510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:41.966049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:41.966481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:41.966899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:41.967688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:41.969423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:41.976203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 385/774] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:41.977316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:42.096780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6196-13bf-4598-bd60-7d98ccf62b47 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.124093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:42.157162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e4140-7114-4d72-a7af-459c1ebcd12e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.182392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.182864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.183145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.184453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.184453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=fd4760e8c6c54b748810f23da3bf3e01) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:42.184453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.187614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:42.195484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 390/775] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/role_assignments?user.id=fd4760e8c6c54b748810f23da3bf3e01&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:42.214724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.215777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.216217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.216632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] PATH_INFO: `/v3/services/network` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.217376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.219023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:42.229721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:42.231039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:42.232057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:42.234687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 386/776] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:41 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:42.241267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:42.361364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b8469-598e-42a7-9156-e7668b4430ba None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.398369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.398978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.399260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.399534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.400427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] RBAC: Adding query filter params (name=network) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:42.400730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.402194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:42.412081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 391/777] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:42.414666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:42.433474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:42.530664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b995ada-fb90-446e-b5c9-b4502042748c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.573249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.573885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.574164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.574436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.575070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] RBAC: Adding query filter params (type=network) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:42.575373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.576746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:42.582232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 387/778] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:42.588093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:42.655974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:42.743865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43caccb5-6231-49ea-877e-0de65a822338 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.794604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.795131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.795410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.795680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.796382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] RBAC: Adding query filter params (interface=public, service_id=c65ce462c0484ef4887aec2c27bee203, region_id=RegionOne) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:42.796684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.798081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15babe-1e64-4e71-8b17-235e1ec57f7b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:42.813175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 392/779] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:24:42 2022] GET /identity/v3/endpoints?service_id=c65ce462c0484ef4887aec2c27bee203&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:42.818868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:42.911884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:42.953631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4352-b17f-4055-b6e0-5d942bfe5074 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:42.993320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:42.993958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:42.994236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:42.994511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:42.995112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:42.996473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9baeb-563e-46d4-91be-8224b2130e1f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:43.002418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 388/780] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:24:42 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:43.229238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c66f-f472-400b-995c-349c5ab0e8ef None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:43.229621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c66f-f472-400b-995c-349c5ab0e8ef None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:43.229832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c66f-f472-400b-995c-349c5ab0e8ef None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:43.231404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 393/781] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:43.237398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428996ea-98b5-4b23-97a5-3344fdae23a8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:43.238185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428996ea-98b5-4b23-97a5-3344fdae23a8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:43.238717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428996ea-98b5-4b23-97a5-3344fdae23a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:43.263129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-428996ea-98b5-4b23-97a5-3344fdae23a8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:43.264721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-428996ea-98b5-4b23-97a5-3344fdae23a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:43.343962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 389/782] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:43.500131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6b9f-a96c-4aa8-ba5d-f30f03cbf687 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:43.500750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6b9f-a96c-4aa8-ba5d-f30f03cbf687 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:43.501242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec6b9f-a96c-4aa8-ba5d-f30f03cbf687 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:43.503072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 394/783] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:43.508609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:43.508895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:43.509170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:43.535508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:43.536792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:43.622935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:43.631956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 390/784] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:43.733130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec6b9f-a96c-4aa8-ba5d-f30f03cbf687 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:43.872282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec6b9f-a96c-4aa8-ba5d-f30f03cbf687 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:43.874080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:43.927417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:43.928053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:43.928328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:43.928594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:43.944088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:43.949006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:43.949963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:43.950810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:43.953838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 395/785] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:43.956108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:43.990575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.069939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5881eff-8441-4390-81d5-db03ab7ca98f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.105561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.106196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.106472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.106746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.107408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:44.107710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.109060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.118351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 391/786] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:44.123770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.186908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724860-7890-42d5-8f5f-4a452f572fe0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.194425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:44.240907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c069-e7ed-4fc1-a1d4-5b04d031ed85 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.278722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.279449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.279792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.280135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.280794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.281625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.282172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.282635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.292433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.294369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:44.309718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:44.310721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:44.311590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:44.311590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:44.311590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:44.311590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 392/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:44.316408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.322377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:44.328012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:44.328974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:44.329837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:44.332455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 396/788] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:44.338546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.415488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:44.431339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa75a8-21c9-4089-a947-618d235ef67a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.442891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:44.472771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.474887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.476117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.476589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.477442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:44.478089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.480228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.502854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 393/789] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:44.516592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.541606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18ee43-2057-4747-af6c-460cd66fff28 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.576912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.577252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.577487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.577779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.578448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:44.578751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.580126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.597759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 397/790] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:44.597759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.703739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:44.714843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5e43b-5669-4b4a-8f0b-cf5d5466a5b6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.784857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899f8e-a9d7-4034-94f0-ee4cc5ec350e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.786541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.787192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.787469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.787737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.803632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.805171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-93b1f113-2213-474d-bb7c-656751bd89cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:44.822034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:44.823076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:44.823956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:44.823956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:44.823956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:44.823956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 398/791] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:44.824813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9fa7-2eb7-4802-a598-39325e631d0c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.825096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9fa7-2eb7-4802-a598-39325e631d0c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.825369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9fa7-2eb7-4802-a598-39325e631d0c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.831691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 399/792] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:44.832522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9fa7-2eb7-4802-a598-39325e631d0c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:44.841168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:44.841788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.842067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.842333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.850472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:44.851970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-569fcd65-58e4-4bce-8c39-f07ff1cc7e1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:44.864950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:44.865916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:44.866865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 394/793] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:44.867914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:44.868021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:44.871249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:44.887660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:44.889030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:44.916750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:44.963352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9fa7-2eb7-4802-a598-39325e631d0c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:44.981847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 395/794] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:44.982798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.000862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.002127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.002615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.003323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.004626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:45.005233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.007390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53555813-15b5-49ab-a3fd-fb4b625b4107 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.011196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.026292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 400/795] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:45.028347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb491-719b-48bc-8e9f-9b3b6f00efa7 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.028838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb491-719b-48bc-8e9f-9b3b6f00efa7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.029391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cb491-719b-48bc-8e9f-9b3b6f00efa7 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.033771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 401/796] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:45.033771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb491-719b-48bc-8e9f-9b3b6f00efa7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.099024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd7b45-71eb-4777-b659-295105176f73 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.139683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.140679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.141055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.141519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.142108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cb491-719b-48bc-8e9f-9b3b6f00efa7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.142454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:45.142856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.144531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083806e-00bf-42c7-9b59-5d1e26573c66 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.164502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 396/797] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:45.165939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.166290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.166659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.179756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de860514-4621-4330-8403-f168e3e04538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.180679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860514-4621-4330-8403-f168e3e04538 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.181183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860514-4621-4330-8403-f168e3e04538 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.181647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de860514-4621-4330-8403-f168e3e04538 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.188120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:45.189325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:45.189740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de860514-4621-4330-8403-f168e3e04538 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.191486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de860514-4621-4330-8403-f168e3e04538 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.204002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-de860514-4621-4330-8403-f168e3e04538 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:45.206308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:45.207213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:24:45.208193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:45.210810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 402/798] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:45.211842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de860514-4621-4330-8403-f168e3e04538 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.278780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.328991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de860514-4621-4330-8403-f168e3e04538 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.366677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.367306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.367580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.367855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.379810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.381321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.398312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 397/799] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:45.398312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:45.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:45.399650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:45.401028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:45.401028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:45.401028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:45.401028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 403/800] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:45.401028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.512384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4ea5e-6256-4a79-8962-2047dbfd33e7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.524478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.525396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530c6be-f860-4799-a7fc-904b7acbcd51 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.554387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.555005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.555205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.555458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.556078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.557435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:45.566159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:45.567156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 15:24:45.568030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:45.569595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.570468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.570940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.571403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.572168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 404/801] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:45.572572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:45.573005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.573289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.574990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.605257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 398/802] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:45.606643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.616621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.687288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692fc39-6a15-45ad-abc6-2b176ad41f91 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.722208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b74b1e-c977-429e-b6e6-f68dc1b36c8c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.723755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.724372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.724651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.724949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.725591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:45.725934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.727408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.744019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 405/803] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:45.744019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.764127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.764725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.764994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.765255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.765956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:45.766251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.767598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.772470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 399/804] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:45.773215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.775674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.839813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:45.843882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0057078-1213-44b2-b803-c46bffb4ed5f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.870571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbcab1-e9ae-4791-83b6-b00e603a1d96 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:45.876225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.876825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.877103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.877371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.904075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:45.904691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:45.904963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:45.905233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:45.916010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:45.920870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:45.922872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 400/805] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:45.923983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:45.962437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:45.963871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc439-8f87-49d8-9b4d-c19e5a66998b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:45.992164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.024096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e2019-731c-4fb6-af9a-36f5ab7eacbc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.051495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.058635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.059250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.059527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.059798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.060198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 406/806] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:24:46.061421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731726-61f2-4516-9b8f-e47aaa5d4734 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.061704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731726-61f2-4516-9b8f-e47aaa5d4734 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.061999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4731726-61f2-4516-9b8f-e47aaa5d4734 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.063208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 407/807] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:46.063892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731726-61f2-4516-9b8f-e47aaa5d4734 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.071711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.073140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:46.084253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:46.085140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:46.086081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 401/808] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:46.086564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.167364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4731726-61f2-4516-9b8f-e47aaa5d4734 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.182589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7d0-3adb-481d-8e61-558c7d6eca34 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.197622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.203271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.203862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.204141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.204407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.205026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:46.205334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.206731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.212454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 408/809] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:46.213181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.216378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.217136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.217318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.217594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.218285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:46.218585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.219960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036d0b3-3d52-43d3-808c-0b7f5ddf92f1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.228386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 402/810] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:46.229665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.229986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.230260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.249838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:46.251107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:46.301501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.323601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 403/811] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:46.324455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.432067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76085-019b-4974-9b3c-efcb9ddab321 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.435246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295064e7-c860-41ce-8f20-294f7a65b30f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.466299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.466912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.467188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.467456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.472089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.472743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.473094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.473393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.475146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:46.475453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.477586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.477691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.479103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.497645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 404/812] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:46.497833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:46.498709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:46.499595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:46.499595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:46.499595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:46.499764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.499844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 409/813] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:46.499844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.543954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.547660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.603188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb256-df39-430c-b579-8ad3eafe6bc4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.606942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd1f-988c-4cad-add6-e4aaad05d4fa None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.636477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.637091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.637371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.637647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.639363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.639952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.640228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.640493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.641145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.642514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.647917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.649362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.663361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 405/814] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:24:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:46.664190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:46.665285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:46.666254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:46.667293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:46.667293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:46.667293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:46.667293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 410/815] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:46.667584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.789538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.792788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d6e8f-c45e-468c-a7be-ba02b508aeac None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.799269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:46.811630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976532-c6bc-48f2-94a6-b542b1b4de9b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:46.832085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.832696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.833508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.834801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.834801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:46.834801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.836098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.850769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:46.851875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:46.852149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:46.852596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/504b251bfd13480a92e088d0f81d81ff/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:46.852702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 411/816] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:46.853315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.855314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=504b251bfd13480a92e088d0f81d81ff, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:46.857409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:46.874545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 406/817] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:46 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/504b251bfd13480a92e088d0f81d81ff/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:46.876563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:46.988650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdad74-3ad8-47b0-a191-242738089e7d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.027932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.028563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.029013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.029292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] PATH_INFO: `/v3/services/network` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.030003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.031483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.031835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b18cb-55c2-47eb-9490-92b03751eace None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:47.048318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:47.049542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 15:24:47.050555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:47.053871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 412/818] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:47.054918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.084168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.086625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.087243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.087507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.087774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.088415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.088713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.090112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.107901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 407/819] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.107901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.126816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.180408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4c83-49ff-4e78-a04d-1339061d5e96 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.217692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.218340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.218610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.218871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.225822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.227295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:47.238601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:47.239694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:47.240595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 413/820] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:47.241085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.241839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526b269-5d4d-4d28-b9cc-5214d3a60766 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.286031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.286994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.287503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.288356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.289177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.289685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.291911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.298344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 408/821] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.299452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.339123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.357014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa6afc-bf2a-49b2-8a69-fc47802e37e7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.397778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.398563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.399014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.399451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.403029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.408669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.410758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:47.423220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:47.424211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:47.425197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:47.427637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186e43d-2e19-41da-b38f-cf82b7b692d8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.428145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 414/822] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:47.429483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.472078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.472689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.472971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.473244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.474006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.474314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.476120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.492174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 409/823] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.492740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.535810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6077e-3bd8-49b7-a889-0562d6e66871 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.580313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.581076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.581377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.581636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.582314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] RBAC: Adding query filter params (type=network) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.582611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.584367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.591094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 415/824] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.591981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.606647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.622633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6964a0d-bbfa-4094-b843-8abb19d2d167 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.661924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.662945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.663457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.663933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.664864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.665373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.667037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.676129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.697407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 410/825] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.698973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.737514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea08cc-4173-4776-9170-2dc15d4d192c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.777078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.777605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.777909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.778175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.778888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:47.779457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.780977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.794288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 416/826] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:47.795069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:47.823464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55f5e1-1305-4c12-b1e0-154786e6ef7f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:47.898739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:47.899352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:47.899625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:47.899891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:47.900814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:47.903885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:47.940389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 411/827] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:24:47 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:47.956920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:47.989844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ac90-9f3f-421f-881c-01223ffcfb03 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:48.052381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:48.053394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.053940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.054419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.067018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:48.069488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:48.087208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:48.088301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:48.089223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:48.089223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:48.089223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:48.091506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 417/828] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:48.097012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:48.160706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:48.222347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb733-517a-42e5-8557-0e0d8c231a23 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:48.260650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:48.261263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.261542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.261847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.262498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:48.262800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:48.264171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:48.278414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 412/829] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:48.283727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:48.403819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff611f6-903a-4257-a3c4-cd97b2e73efe None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:48.423995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:48.440653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:48.441283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.441560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.441870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.449677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:48.451189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:48.462576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:48.463582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:48.465051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 418/830] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:48.469276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:48.573321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9867639-b57f-42cb-b782-5a70a93590d1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:48.587514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:48.610703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:48.611308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.611587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.611858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.612544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:48.612849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:48.614820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507986-2aca-4d15-a7e6-7dcab9cf3670 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:48.627240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 413/831] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:48.633600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:48.749698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7095cb8-e68a-4f4f-9c51-83e5f3b8ef29 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:48.784330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:48.785245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.785664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.786661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/fd4760e8c6c54b748810f23da3bf3e01/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.802547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=fd4760e8c6c54b748810f23da3bf3e01, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:48.804227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc833156-3ca5-4171-9f3b-08c3b227f1d2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:48.820235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 419/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:24:48 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/fd4760e8c6c54b748810f23da3bf3e01/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:24:48.970603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977255cd-e508-4e59-9ab6-c3daf96eabb0 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.970890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977255cd-e508-4e59-9ab6-c3daf96eabb0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.971168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977255cd-e508-4e59-9ab6-c3daf96eabb0 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.972781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 414/833] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:48.979053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b456b-f129-46c5-b33d-9c07aa2cd183 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:48.979577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b456b-f129-46c5-b33d-9c07aa2cd183 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:48.979577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b456b-f129-46c5-b33d-9c07aa2cd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:48.999807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b13b456b-f129-46c5-b33d-9c07aa2cd183 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:49.000696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b13b456b-f129-46c5-b33d-9c07aa2cd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:49.028270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:49.076281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 420/834] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:49.281587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c223f-d429-4bee-9215-6b3fa6ca7794 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.282205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c223f-d429-4bee-9215-6b3fa6ca7794 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.282205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c223f-d429-4bee-9215-6b3fa6ca7794 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.283770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 415/835] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:49.289641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.289976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.290258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.311999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:49.313173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:49.367952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c223f-d429-4bee-9215-6b3fa6ca7794 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:49.392683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 421/836] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:49.486142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c223f-d429-4bee-9215-6b3fa6ca7794 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:49.520288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:49.520999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.521280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.521542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.522157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:49.523600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:49.532922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:49.533906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:49.534742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 416/837] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:49.542848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:49.636845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:49.648134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362425ef-9640-481e-b509-e4078b0dfe01 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:49.659468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:49.684066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:49.684909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.685332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.686321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.687019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:49.687327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:49.688686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:49.695148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 422/838] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:49.699768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:49.717367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:49.813934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035e8a9-8f68-44c8-a96c-edf689e21112 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:49.815654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64e6a-354b-4946-956d-ca19e895c1ae None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:49.852474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:49.853084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.853354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.853626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.854279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:49.854574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:49.855928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:49.865899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 423/839] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:49.871297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:49.872349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:49.872834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:49.873330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:49.887015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:49.892553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:49.893561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:24:49.894458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:49.901819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 417/840] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:49.904264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:49.927442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:50.026322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3c9e-b897-4ef1-b734-b3683d8bce08 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.064432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.065368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.065890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.066395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.067329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:50.067854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.069415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:50.081898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 424/841] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:50.085620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.186095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:50.193816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf145-61c1-4b46-9f8a-e6026e5e08f2 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.234557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.235238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.235525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.235798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.246284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.247734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-640675dd-4d75-4e38-aa76-7dddeccf670a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:50.263192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:50.264261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:50.265584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:50.265584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:50.265584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:50.265584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 418/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:50.272557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.364746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:50.386503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8575d8-cece-4d40-bf89-f933607ca26f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.398740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35372-7473-43cb-b7d8-30627e497639 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.399254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35372-7473-43cb-b7d8-30627e497639 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.399254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35372-7473-43cb-b7d8-30627e497639 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.401098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 419/843] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:50.405952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.406231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.406505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.424539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.425497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.426056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.426590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.427460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:50.427725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:50.428223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.428628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:50.430030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:50.444188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 425/844] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:50.449238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.517877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 420/845] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:50.561064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d7dba-9abe-4f39-92cb-f7f9714c5c53 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.597010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.597996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.598544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.599045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.606756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.608385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:50.611332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:50.623255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:50.624368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 15:24:50.625532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:50.631835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 426/846] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:50.637682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.719467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:50.749982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e30ce-acac-41c4-9479-fc2d0d2813fd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.787059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.788006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.788498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.788984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.789917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:50.790414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.792037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:50.810791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 421/847] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:50.816404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.818640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:50.939180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3691-0c75-4236-a507-6ff08d8a6bef None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.940114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd004-2046-40aa-a20a-222aa84586c1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:50.982575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.983220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.983496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.983764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.993169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:50.994186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:50.994661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:50.995695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:50.996486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:50.998928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.003124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:51.015677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:51.016852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:51.017835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:51.022877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 422/848] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:51.030422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.071394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.075786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.078558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a9af8-ffce-4b6e-bd5d-26e7669eabad None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.144877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209603e5-e15e-43e2-b48e-28f952e2b9b7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.179217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.179813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.180086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.180357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.181008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:51.181318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.182712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea50b00-aae4-4bc6-83f0-4cb91c87261a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.187393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 427/849] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:50 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:24:51.188922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad93a-53ed-4d64-9dee-e1462e0a921d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.189440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad93a-53ed-4d64-9dee-e1462e0a921d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.189911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad93a-53ed-4d64-9dee-e1462e0a921d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.191708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 428/850] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:51.193159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad93a-53ed-4d64-9dee-e1462e0a921d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.193872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 423/851] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:51.196893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.197177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.197448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.215052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:51.216235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:51.275826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.286661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 424/852] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:51.287717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.306609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.310606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad93a-53ed-4d64-9dee-e1462e0a921d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.350388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.351498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.351847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.352185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.365306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.367018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:51.385791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:51.386916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:51.387798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:51.387798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:51.387798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:51.392128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 429/853] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:51.393165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.405310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24efff-086c-455a-bef4-c9e7c6804da8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.442779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.443717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.444190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.444649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.445560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:51.446094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.447800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.452729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 425/854] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:51.520907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bff7b-d990-4e7e-b29f-600326cc7c06 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.556957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.560560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.562496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.562946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.563412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.564326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:51.564785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.566386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.580787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 430/855] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:51.586634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.604535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.649204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.680455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78d98-89d4-4a11-8c84-f0fc447bb930 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.711729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba99c-d5fa-4168-8269-b79f5ad185dc None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.725848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.726736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.727352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.727830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.743420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:51.749374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:51.750544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:24:51.751584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:51.752366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.752366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.752366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.752366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.758043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 426/856] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:51.759850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.764647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.766856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:51.778822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:51.779949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:51.781041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:51.782357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 431/857] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:51.788133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.873145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.886606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8a85-f39e-4946-bb08-56c230f9fd6c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.907219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119f58-b005-4b02-a5f6-917a28582146 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:51.912141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:51.936049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.937516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.937989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.938695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.939752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:51.940205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.942434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.945935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:51.946644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:51.947015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:51.947394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:51.948183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:51.948576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:51.950188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:51.958435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 427/858] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:51.959614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:51.968682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 432/859] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:51.970179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.085156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a25b29-eb08-462d-ae92-74f0ea77b11f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.101749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7421-9459-4492-b787-dbacbe2c7f43 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.133011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:52.136194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.137203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.137654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.138184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.138915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.139860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.140652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.141361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.142749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=504b251bfd13480a92e088d0f81d81ff) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:52.142872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.144415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.153391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.155091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.157928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 433/860] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/role_assignments?user.id=504b251bfd13480a92e088d0f81d81ff&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a0cf761c-e902-47bf-97c0-6aeb3b922f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:52.174791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:52.176000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:52.176947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:52.176947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:52.176947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:52.178785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 428/861] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:52.184715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.196448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777a8a-3b82-498a-8aba-de12af0fc68f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.197758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777a8a-3b82-498a-8aba-de12af0fc68f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.198201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b777a8a-3b82-498a-8aba-de12af0fc68f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.200399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 429/862] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:52.206661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.207080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.207459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.229381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:52.230825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:52.262829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:52.322390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 430/863] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:52.324487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d7856-d9a4-4ff1-94a4-214af4a32417 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.358429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.359310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.359735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.360151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.360933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:52.361381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.363162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.376924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 434/864] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:52.383148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.490452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1f4f-c4ab-4378-a7f0-5e615ce7f91c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.525970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.526887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.527347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.527782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.535144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.537331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:52.549146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:52.550119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:52.551045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:52.553838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 431/865] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:24:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:52.561955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.597641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.619075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:52.628464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:52.671175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db399cd-e857-4beb-a509-1a9514a0f2d1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.718195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.719167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.719874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.720426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.721416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:52.721982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.724320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.729230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d44918-2d52-4118-b2fa-5dd71087e057 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.745261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 435/866] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:24:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:52.750291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:52.765025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.765624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.765947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.766219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:52.766880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:52.768247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:52.801757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 432/867] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:24:52 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:24:52.873068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abefa68-1921-4bb5-b557-dc696d27fc07 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:52.889958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:52.921231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:52.921890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:52.922170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:52.922496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.001974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.003749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.105086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 436/868] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:52 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 15:24:53.110326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:53.198528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:53.218802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f103894-49b8-4fb7-8a44-77a5ed616fd0 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:53.253836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:53.254390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.254698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.254965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.265561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.267083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:53.286578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:53.287534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:53.288400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:53.288400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:53.288400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:53.288400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 433/869] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:53.294958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:53.307242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:53.402280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02f9f-db9f-4fc5-a279-9055c941d420 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:53.437263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:53.438179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.438630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.439040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.439819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:53.440260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.441772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.453910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 437/870] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:53.461862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:53.569033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9956c-58a7-4043-9f9c-1b6fc61f8ab1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:53.605909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:53.606563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.606843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.607112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.609367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:53.615819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.617301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-85fa2a2f-ce65-4491-b310-f04e1b30205a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:53.629945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:53.630870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:53.631743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 434/871] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:53.637088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:53.712889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:53.723162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f8f2-5127-4189-afc4-256db91e2714 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.724032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f8f2-5127-4189-afc4-256db91e2714 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.724310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49f8f2-5127-4189-afc4-256db91e2714 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.725638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 435/872] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:53.731126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.731413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.731691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.747092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c73c-0caa-4974-b5ea-e0b59ec92de2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:53.753952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:53.755297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:53.787512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:53.788551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.788842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.789392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.790216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:53.790606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.792130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.807697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 438/873] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:53.814130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:53.845919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 436/874] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:53 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:53.925282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ab9da-0057-42f1-8023-facfc630d13c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:53.954312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:53.961934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:53.962532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:53.962808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:53.963073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:53.963789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=fd4760e8c6c54b748810f23da3bf3e01) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:53.964093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:53.965501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7336f0-1c53-40a4-9816-b0717534db72 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:53.971957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 439/875] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:53 2022] GET /identity/v3/role_assignments?user.id=fd4760e8c6c54b748810f23da3bf3e01&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:54.147973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:54.252059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1ddf9-a047-4612-af19-3ae8089664aa None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:54.277076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:54.289168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:54.289793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:54.290070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:54.290337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:54.291005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:54.292363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e34a0-0179-43f7-bc60-4d2df365a527 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:54.310261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 437/876] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:24:54 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:24:54.519723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cb70-8829-4ff1-8921-fe443a5a9534 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:54.520908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cb70-8829-4ff1-8921-fe443a5a9534 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:54.520908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31cb70-8829-4ff1-8921-fe443a5a9534 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:54.522411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 440/877] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:54.527973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:54.528258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:54.528577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:54.548876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:54.550106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:54.625335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 438/878] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:54.904593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31cb70-8829-4ff1-8921-fe443a5a9534 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.010136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31cb70-8829-4ff1-8921-fe443a5a9534 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:55.045051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:55.046136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.046631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.047111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.047901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:55.049512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b2280360-4adb-43cf-905c-6c548016f161 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:55.060094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:55.061166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:24:55.062031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.064946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 441/879] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:24:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:55.072033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.171778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dfcfd-c5ac-4566-b3d1-c10a2a7c78eb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:55.184522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265909fb-61fb-42ef-8d89-4e4b0a23d897 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.185098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265909fb-61fb-42ef-8d89-4e4b0a23d897 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.185566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265909fb-61fb-42ef-8d89-4e4b0a23d897 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.186153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:55.187662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 442/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:55.196294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.196811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.197272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.216279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:55.216889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.217167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.217439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.218099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:55.218399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:55.219462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:55.219767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:55.221321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:55.225588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 439/881] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:24:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:55.235107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.285545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:55.305070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 443/882] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:55.359375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69faf1c-f372-442b-abd7-8e00ed1c6b69 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:55.396486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:55.397144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.397423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.397692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.398342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:55.398643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:55.400000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:55.404996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 440/883] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:24:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:55.588452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.710993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188385b-93c7-4c74-bb36-611db0aafa06 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:55.746390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:55.747354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.747780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.748196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.748921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:55.750513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:55.759798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:55.760992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:55.762082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:55.768117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 444/884] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:55.771365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.815121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:55.879216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f1bf-cb1c-4d0a-b103-af93578f9d91 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:55.915870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b457c0-6995-4c83-b016-970725573723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:55.916748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b457c0-6995-4c83-b016-970725573723 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:55.917177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b457c0-6995-4c83-b016-970725573723 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:55.917611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b457c0-6995-4c83-b016-970725573723 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:55.918415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b457c0-6995-4c83-b016-970725573723 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:55.918868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b457c0-6995-4c83-b016-970725573723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:55.920441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b457c0-6995-4c83-b016-970725573723 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:55.929586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 441/885] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:55.931638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:55.989502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:56.045366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cf5c1-6bf9-4c22-abf5-4872d71cb625 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:56.083056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:56.083958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.084440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.084880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.085682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:56.086173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:56.087696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:56.093268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 445/886] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:56.099514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b457c0-6995-4c83-b016-970725573723 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:56.213377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b457c0-6995-4c83-b016-970725573723 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:56.214998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:56.250587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:56.251195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.251475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.251744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.252445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] RBAC: Adding query filter params (interface=public, service_id=e7dd1e572a6f4d0c87ad73b3f5faa84f, region_id=RegionOne) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:56.252757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:56.254232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311841-6bda-47b7-9e90-95f2f928bc68 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:56.260339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 442/887] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:24:56 2022] GET /identity/v3/endpoints?service_id=e7dd1e572a6f4d0c87ad73b3f5faa84f&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:56.266064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:56.272127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45572-84ac-40d2-b1aa-5c22df5cd12f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.272414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45572-84ac-40d2-b1aa-5c22df5cd12f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.272691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45572-84ac-40d2-b1aa-5c22df5cd12f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.274496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 443/888] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:56.279756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca87f3-a1a8-4a61-a56b-20ce3fe46a6f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.280038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca87f3-a1a8-4a61-a56b-20ce3fe46a6f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.280309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca87f3-a1a8-4a61-a56b-20ce3fe46a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.299397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-64ca87f3-a1a8-4a61-a56b-20ce3fe46a6f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:56.300580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-64ca87f3-a1a8-4a61-a56b-20ce3fe46a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:56.369679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf662628-58f1-4431-a32d-4d6e192457fb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:56.382222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 444/889] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:56.387058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:56.407276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:56.407894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.408166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.408432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.409045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:56.410448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b925bf7-9295-4557-b477-aa6b1af32017 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:56.417022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 446/890] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:24:56 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:24:56.636515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca099e4-7a9e-4064-9e0d-943efa47e3f6 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.636786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca099e4-7a9e-4064-9e0d-943efa47e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.637132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca099e4-7a9e-4064-9e0d-943efa47e3f6 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.638812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 445/891] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:56.644020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.644547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.644690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.652711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca099e4-7a9e-4064-9e0d-943efa47e3f6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:56.663790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:56.665057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:56.741765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 447/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:24:56.767843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:56.776659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca099e4-7a9e-4064-9e0d-943efa47e3f6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:56.813090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:56.814077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.814533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.814975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.825797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:24:56.830817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:56.831731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:24:56.833083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:56.835326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 446/893] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:24:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:56.841303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:56.948674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c53f-5596-4b07-a1a9-57e8dd04c3bf None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:56.960463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:56.985053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:56.985940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:56.986366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:56.986783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:56.987583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:56.988050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:56.989853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.005879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 448/894] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:24:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:57.009265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.021026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.138300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2320f1-3962-4dd7-8855-d1fa93fac330 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.139434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc302-3e14-4844-a55d-a3dc8e49ff0b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.181041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.181251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.182021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.182303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.182573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.182925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.183579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.184038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.185114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.187146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.196503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.197978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:57.201268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:57.202383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:24:57.203278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:57.210056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 449/895] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:57.212602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:57.213737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:57.214644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:57.215522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:57.215522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:57.215522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:57.219655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 447/896] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:57.220543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.234729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.256165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.330314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98c18-cb1e-4833-a69e-7352d0c36056 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.332206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e39ee-7590-47c8-8101-44f6a6564b58 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.371376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.372651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.373131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.373329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.373887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.374007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.374255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.374528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.375162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:57.375451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:57.375573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.376290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.376826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.378327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.386078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 450/897] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:57.391486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.397173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 448/898] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:57.403460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.474852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.509922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.513155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b42e6-7fc2-4870-b73f-13deb7992dfe None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.513864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a87901-329d-45aa-8e7c-e1b2a2dae78c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.553278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.554248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.554617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.555080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.555801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.556551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.557019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.557639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.559034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:57.559487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.561003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.563249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.564922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.571868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:24:57.572933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:24:57.577892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:57.578938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:24:57.579878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:57.584600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:57.586446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.700730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f5cf-7d42-4318-b99b-5c517641f91e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.708306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f127f7-12d5-434d-8838-3312943e1f45 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.730723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.740148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.740746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.741018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.741285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.742042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:57.742341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.743746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.746567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.747223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.747505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.747775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.748471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] RBAC: Adding query filter params (interface=public, service_id=232d994d140d4f81bcb93ef4e3080855, region_id=RegionOne) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:57.748776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.750159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec6377-852b-439a-915d-16e217d5e851 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.758558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 452/901] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/endpoints?service_id=232d994d140d4f81bcb93ef4e3080855&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:57.760622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0e3a-5e5e-493f-a45b-e724e7c466a9 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.760900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0e3a-5e5e-493f-a45b-e724e7c466a9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.761166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0e3a-5e5e-493f-a45b-e724e7c466a9 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.761794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:57.765787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.766582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 453/903] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:24:57.767662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.767943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.768212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.789206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:57.790374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:57.814757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:57.869756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 454/904] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:57.869756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:57.875286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a058c-1bfd-4f33-b1b9-31ca15f10db1 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:57.913947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:57.914625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:57.914976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:57.915311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:57.915973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:57.917390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:57.923513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 451/905] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:24:57.987634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143b07-9c12-41eb-b69b-f660a1c02bbe None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.026948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.027565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.027839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.028113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.060837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.105498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.107111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:58.146754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:58.200394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.233045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 455/906] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:24:57 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:24:58.239710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:58.259364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2c4e9-de4e-4166-88e6-e43a0f08a81a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.295705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.296323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.296696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.297065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.297903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.299333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:58.315563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.326116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 452/907] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:24:58 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:24:58.364816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e4c31-42d4-422c-afac-89251c97f56e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.411290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.412171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.412623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.413048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.424962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.426825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:24:58.444141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:58.445280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:24:58.446299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:24:58.446299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:24:58.446299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:58.448021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 456/908] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:58.458117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:58.572475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145d96e-aaf1-48c4-84ee-de579693506d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.584285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.612265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.612924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.613206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.613522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.614254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:58.614730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.616100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0e149-d43f-48df-bc21-c4c5c9fc6681 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:58.628730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 453/909] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:58.634833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:58.662689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78b4f-947c-4d02-ad6e-d41b509f50d1 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.662974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78b4f-947c-4d02-ad6e-d41b509f50d1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.663245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb78b4f-947c-4d02-ad6e-d41b509f50d1 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.664698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 454/910] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:24:58.670165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.670638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.670918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.693168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:24:58.694690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:24:58.759996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661ee3-60b3-4f29-abd4-e2bc663c7500 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.771931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.790402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 455/911] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:24:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:24:58.815052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.815674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.815945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.816212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.824124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.825512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:24:58.837126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:58.838151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:24:58.839610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 457/912] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:24:58.844067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:58.949174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:58.952354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c089cfa-6940-4ade-8b2c-c88b065e63e0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:58.987073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:58.987730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:58.988012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:58.988289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:58.989530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:58.989871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:58.991296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.003926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 456/913] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:59.009601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:59.064279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:59.131173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bd893-dc0c-4f9b-8a28-d9f83a6c49c4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:59.170605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:59.171207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:59.171485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:59.171753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:59.172468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] RBAC: Adding query filter params (role.id=08a1d4432bed468ea739453d30bcbe93, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=fd4760e8c6c54b748810f23da3bf3e01) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:59.172772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:59.174222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.176823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab029d-c4fb-4de1-8630-8300a2ccea56 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:59.185874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 458/914] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:24:59 2022] GET /identity/v3/role_assignments?user.id=fd4760e8c6c54b748810f23da3bf3e01&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=08a1d4432bed468ea739453d30bcbe93 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:59.218439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:59.219462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:59.220017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:59.220536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:59.221342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:59.222982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:24:59.233129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:24:59.234507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 15:24:59.235337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:24:59.238218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 457/915] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:24:59.246948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:59.282339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:59.368819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788edffa-e7df-4522-8bc1-4b43e073b58f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:59.406824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:59.407677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:59.408107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:59.408527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:59.409296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:59.409781 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:59.411816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.417144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 459/916] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:59.422812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:59.454689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:59.535793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4cf8-510d-43d9-a662-aa2096376430 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:59.571373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:59.572337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:59.572829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:59.573297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:59.574151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:24:59.574674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:59.576239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582f8a-3e46-4ffb-8f1c-3e98655f6c18 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.581952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 458/917] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 15:24:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:24:59.588363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:24:59.690486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:24:59.698505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42486a-540d-4afc-8d86-e4950aa19279 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:24:59.736638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:24:59.737598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:24:59.738102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:24:59.738599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:24:59.739999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:24:59.741560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcee7f-7d42-4985-bd95-2db73aa954aa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:24:59.765578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 460/918] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:24:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:00.210085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b29fe-595c-41ce-b0cd-04be4a94cc5b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.210615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b29fe-595c-41ce-b0cd-04be4a94cc5b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.210615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b29fe-595c-41ce-b0cd-04be4a94cc5b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.212255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 459/919] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:00.217823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286267-6110-492b-a85e-aaeca512243c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.218120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286267-6110-492b-a85e-aaeca512243c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.218403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f286267-6110-492b-a85e-aaeca512243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.237286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0f286267-6110-492b-a85e-aaeca512243c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:00.238513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0f286267-6110-492b-a85e-aaeca512243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:00.321848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 461/920] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:00.594591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b29fe-595c-41ce-b0cd-04be4a94cc5b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:00.603284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88928e-4915-469b-939a-9554bc329535 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.603856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88928e-4915-469b-939a-9554bc329535 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.604769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88928e-4915-469b-939a-9554bc329535 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.606952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 462/921] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:00.611799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.612086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.612359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.632072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:00.633269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:00.706520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:00.722912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 463/922] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:00.728832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b29fe-595c-41ce-b0cd-04be4a94cc5b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:00.764064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:00.764976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.765456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.765977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.766768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:00.768341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:00.777488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:00.778459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 15:25:00.779341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:00.782064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 460/923] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 15:25:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:00.794852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:00.806040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:00.906403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317bc0-f47e-43bc-aeb0-ae00caf86525 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:00.943020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:00.944018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:00.944538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:00.945020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:00.945887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:00.946490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:00.948047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:00.957932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 464/924] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:00.959491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.033175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.068984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8082e63-cf16-45f7-aa38-85ab6d0fda8e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.106564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.107574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.108333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.108568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.109782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.110635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:01.111335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.113069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.123371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 461/925] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:01.128867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.152976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.155472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d137-565e-48c1-9ba4-a1d9e2b977b2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.201885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.202434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.202714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.202982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.203561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.205022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:01.215792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:01.216784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:01.218248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 465/926] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:01.223304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.258083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ec9ee-91c6-413c-a367-6714f1f701ef None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.304865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.306078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.307387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.307891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.308785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.310410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.346380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 462/927] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:25:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:01.349906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec402da-904a-4bb5-ab9b-fac71f845953 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.393670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.400709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.401314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.401766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.402051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.402681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:01.402981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.404786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c47b4-f95b-4264-a8b1-359393d1f39a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.411380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 466/928] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:01.416968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.456962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5022-cc69-4d3b-a356-064cdd82493d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.457160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5022-cc69-4d3b-a356-064cdd82493d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.457485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5022-cc69-4d3b-a356-064cdd82493d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.459040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 467/929] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:01.464710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.465313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.465855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.488473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:01.489819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:01.514205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.554729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0c4d-ecfe-4446-b6a9-2add9581d11c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.575491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 468/930] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:01.596018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381537c-079b-4921-a546-014642492a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.596680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381537c-079b-4921-a546-014642492a68 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.596960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381537c-079b-4921-a546-014642492a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.597232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381537c-079b-4921-a546-014642492a68 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.597915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381537c-079b-4921-a546-014642492a68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:01.598262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381537c-079b-4921-a546-014642492a68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.599641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381537c-079b-4921-a546-014642492a68 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.605415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 463/931] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:01.611624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.717113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d532-96be-4416-bcf7-6f43cebd7913 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.742061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.753645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.754802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.755084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.755356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.756111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] RBAC: Adding query filter params (interface=public, service_id=8138661fb00843df9752e3f6478e9bf4, region_id=RegionOne) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:01.756423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.758032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.767895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 469/932] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/endpoints?service_id=8138661fb00843df9752e3f6478e9bf4&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:01.769215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381537c-079b-4921-a546-014642492a68 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.844373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:01.886405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381537c-079b-4921-a546-014642492a68 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:01.930532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:01.931564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:01.932043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:01.932526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:01.933359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:01.935022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:01.937707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:01.944698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 464/933] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:25:01.967207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c65e10-2e61-44c2-af4f-c8fc8b976596 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.006406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.007453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.007930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.008422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.021330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-da8557b4-4ef4-4f28-a608-d1819aa06a90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:02.026826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:02.027834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:02.028688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.031534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 470/934] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:25:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:02.037885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.040529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572ded-e053-4b3b-a59e-bcd8c879dff2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.041147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572ded-e053-4b3b-a59e-bcd8c879dff2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.041421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572ded-e053-4b3b-a59e-bcd8c879dff2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.042988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 471/935] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:02.049951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.050252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.050482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.069797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:02.071014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:02.127723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:02.157805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 472/936] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:02.162258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba894c-0720-4009-9ac6-849f1d175c1c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.199598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.200443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.200885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.201315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.202209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:02.202652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.204160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.212906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 465/937] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:02.218840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.323322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51723f6b-5b4d-413d-bd59-5e8116c8fa75 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.358685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.359542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.359964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.360409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.371591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.373222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:02.388964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:02.390146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:02.391227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:02.391227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:02.391227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.392870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 473/938] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:02.398940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.430880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.463879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:02.475031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:02.527576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b9b4b-12e0-434b-bf83-1577ca0a74e3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.546230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9478e-cb03-4bed-8bce-ccbb1bfe1202 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.570881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.571491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.571769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.572098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.572747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:02.573110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.575369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.590350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.595593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.595720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 466/939] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:02.595802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.595802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.595802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.596431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.597437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.600415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING keystone.server.flask.common [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 12 15:25:02.621850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.sql.core [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 15:25:02.621850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 15:25:02.621850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [parameters: {'id': 'cb80b915621d45c2af55549479cc47ed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 15:25:02.621850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb80b915621d45c2af55549479cc47ed.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb80b915621d45c2af55549479cc47ed. Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:25:02.630704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 12 15:25:02.631510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application yield resource Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise self.value Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application session.commit() Sep 12 15:25:02.632469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.flush() Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application compat.raise_( Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 15:25:02.633353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 15:25:02.634282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:25:02.635085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [parameters: {'id': 'cb80b915621d45c2af55549479cc47ed', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.635942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:02.638325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cb80b915621d45c2af55549479cc47ed. Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 474/940] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 12 15:25:02 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:02.640327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.737283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea444-2ac3-4471-a8f3-845d0221a559 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.757187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:02.762318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:02.778129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d5186-babf-4d8c-b0e7-06eb13c7b222 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.780546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.781833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.786147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.786423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.796592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.798315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:02.811249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:02.812230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:25:02.813202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:02.815773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 467/941] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:02.821120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.826195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.827077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.827592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.828067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.837533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.839629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:02.853229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:02.854609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:02.855556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:02.862869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 475/942] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:02.864141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:02.930037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456c430-c6c5-479f-94b6-c996d01a6a20 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.967969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:02.968610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:02.968888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:02.969156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:02.969955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:02.970211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:02.971783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:02.983299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e9566-71b2-4c14-bc12-33ce1492ae07 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:02.997027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 468/943] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:02.997848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:03.021826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.022878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.023660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.024168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.025471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:03.025948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.027491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.042506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:03.056052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 476/944] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:03.105647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d312-fd70-4832-9e43-99990e3702a4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:03.149052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.149699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.150008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.150535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.162005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.163482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:03.179874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:03.180895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:03.181799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:03.181799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:03.181799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:03.181799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 469/945] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:03.188721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:03.199731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:03.299320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadab29-f1d0-448a-9dd2-a56b59d0239d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:03.338479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.339103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.339392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.339666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.340314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:03.340618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.342019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.355157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 477/946] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:03.360689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:03.456118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:03.466899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76290f-6b1f-409d-ac74-79a36c9d8814 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:03.502272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.502901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.503183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.503455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.510472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.511923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:03.523848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:03.524743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:03.525936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 470/947] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:03.532675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:03.604995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:03.646354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae686e6-79c2-45cc-ac1d-cb30e7c0633f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:03.683922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.689752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a7dbe-660c-46dd-ae1f-aae5f03273a3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.701692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 478/948] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:03.708223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:03.732230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967467-9698-46ff-9cc7-5c2cf60ce87a None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.732557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967467-9698-46ff-9cc7-5c2cf60ce87a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.733075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0967467-9698-46ff-9cc7-5c2cf60ce87a None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.734709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 479/949] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:03.740418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.740865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.741558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.763084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:03.764606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:03.826899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b6f53-2dc7-4b47-836e-28b617c09b97 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:03.841777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 480/950] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:03.868813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:03.869690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:03.870215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:03.870674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/fd4760e8c6c54b748810f23da3bf3e01/roles/08a1d4432bed468ea739453d30bcbe93` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:03.872983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=fd4760e8c6c54b748810f23da3bf3e01, role_id=08a1d4432bed468ea739453d30bcbe93)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:03.874763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff1000-f438-42d7-8bb5-6d7c6da27563 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:03.897960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 471/951] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:25:03 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/fd4760e8c6c54b748810f23da3bf3e01/roles/08a1d4432bed468ea739453d30bcbe93 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:25:04.114545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:04.175240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:04.216806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bada-c356-4696-b7c6-03ea473c82a8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.217458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bada-c356-4696-b7c6-03ea473c82a8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.217961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8bada-c356-4696-b7c6-03ea473c82a8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.219745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 472/952] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:04.219937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304cd86-be5e-48d3-a158-b891c2499aaa None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:04.225115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.225666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.226262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.244948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:04.246588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:04.255853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:04.260278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:04.260904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.261180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.261446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.262061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:04.263723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:04.274113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:04.275601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.276501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 481/953] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:04.281823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:04.335316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 473/954] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:04.402151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe54-0ad4-4df2-83ac-815d8328c2dd None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:04.425420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:04.440770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:04.441372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.441668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.441972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.442593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:04.442890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:04.444307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:04.449535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 482/955] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:04.454781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:04.557859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47018f9a-50ae-4f8e-af47-0b345e1fc927 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:04.591779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:04.592382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.592658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.592925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.593549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:04.593877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:04.595243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:04.600761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 474/956] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:04.628280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:04.739613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880406f7-458a-4086-996d-36f9a67e39e0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:04.777309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:04.778214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.778632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.778898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.779474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:04.780834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:04.791405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:04.792700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:04.793963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 483/957] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:04.798728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:04.809316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:04.906434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dff12f-44a6-433a-abab-ecf1ad165ef6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:04.941151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:04.941703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:04.942002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:04.942266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:04.942960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:04.943261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:04.944673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:04.949720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 475/958] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:04.954987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:05.008083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:05.064098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89615b-6ec7-474f-b2dd-992391237d3a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:05.099788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:05.100394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:05.100672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:05.100942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:05.101564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:05.101897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:05.103253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1824efb-2058-4395-8b96-07fa4112cf0b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:05.108386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 484/959] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:05.114071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:05.185998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:05.218594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7a98-870e-4c1b-9438-917377e50c3b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:05.253075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:05.253985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:05.254927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:05.255362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:05.256179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:05.257760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683564b7-9dbe-4999-836e-ae1d9ff2f514 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:05.281447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 476/960] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:25:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:05.416529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94c79-3983-4731-9030-f87a2165a0f8 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:05.417393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94c79-3983-4731-9030-f87a2165a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:05.417852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94c79-3983-4731-9030-f87a2165a0f8 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:05.419807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 485/961] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:05.427810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:05.428500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:05.428981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:05.449787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:05.451351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:05.529489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 477/962] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:05.811913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94c79-3983-4731-9030-f87a2165a0f8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:05.918025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94c79-3983-4731-9030-f87a2165a0f8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:05.932657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:05.954686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:05.955655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:05.956133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:05.956601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:05.957485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:05.959179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:05.975413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.sql.core [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 15:25:05.975413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 15:25:05.975413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [parameters: {'user_id': '5e8b3f02347c4b2182a9cfb046efda24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 15:25:05.975413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:25:05.982967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:25:05.983918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application yield resource Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application next(self.gen) Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise self.value Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application session.commit() Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 15:25:05.984894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.session.flush() Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application compat.raise_( Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 15:25:05.985818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 15:25:05.986747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application conn.query(q) Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application result.read() Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 15:25:05.987628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [parameters: {'user_id': '5e8b3f02347c4b2182a9cfb046efda24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:05.988638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 12 15:25:05.991454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 15:25:05.993649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:05.996300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 486/963] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 15:25:05 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:06.005046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:06.060353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:06.117848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb73627-b777-4c9c-8ecc-a7cce9313e82 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:06.156122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:06.156753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.157032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.157301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.165301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:06.166841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-24230025-a38d-490f-89f4-1ee1fe97ba49 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:06.179141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:06.180110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:06.181070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 478/964] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:06.186810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:06.187342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2abd9-f279-4600-af8b-e00f063f319f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.187626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2abd9-f279-4600-af8b-e00f063f319f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.187895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2abd9-f279-4600-af8b-e00f063f319f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.189422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 479/965] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:06.194300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.194583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.194855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.213558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:06.214875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:06.293889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 480/966] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:06.315227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd705f7-ab06-4605-bfc6-17fb248049d6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:06.354651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:06.355267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.355545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.355815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.356517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:06.356874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:06.358525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:06.396885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 487/967] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 15:25:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:06.572950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:06.619842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:06.682379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e963b-86e1-4d11-b932-d6ca7ae79d2b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:06.720757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:06.721381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.721658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.721957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.732153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-3d7a1de4-f5b7-4658-8dcf-d83e75f3ea61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:06.736903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:06.738089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:06.738977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 481/968] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:25:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:06.745613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:06.780535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:06.854534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dd5b4-5e6b-45eb-ac8d-99856dd6b9fb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:06.888360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:06.888976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.889255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.889529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.890285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:06.890597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:06.891661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c488-c304-4d89-819f-4947b45e7980 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.891949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c488-c304-4d89-819f-4947b45e7980 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.892044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:06.892224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c488-c304-4d89-819f-4947b45e7980 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.896040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 482/969] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:06.901039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:06.901474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:06.901768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:06.909358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 488/970] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:25:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:06.911335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:06.924405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:06.925838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:06.998144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 483/971] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:07.012549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.022271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474deec8-bc47-48c8-97fa-cc33fe9d22dc None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.056654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.057273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.057553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.057851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.069120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.070618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:07.084731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:07.085671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:07.091639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:07.091639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:07.091639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:07.091639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 489/972] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:07.091868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.123396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.194530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a72dd-8e8a-428a-96de-d8df1c9ced3a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.227084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.227676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.227948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.228213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.228837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:07.229133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.230501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.246221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 484/973] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:07.247583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.264703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.351910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c819872-5e20-46fa-b5c9-d07a547b9f3f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.359838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.370884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47ff8b-1351-41e6-ad2a-120bb664726b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.388974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.389652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.389978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.390252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.398556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.400527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.405866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.406466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.406742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.407007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.407645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.408978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15540e-326a-426e-85e9-c5234cba72a7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:07.413343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:07.414567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 15:25:07.415733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:07.418367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 490/974] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:07.424432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.433416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 485/975] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:25:07 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:25:07.436219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.541656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc875c14-9cbc-445e-bb63-4bb35bfe88e6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.545990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad80d-60e4-4a96-8292-c301b3625a5c None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.546271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad80d-60e4-4a96-8292-c301b3625a5c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.546541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad80d-60e4-4a96-8292-c301b3625a5c None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.548132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 486/976] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:07.554618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.555131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.555555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.575155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:07.576357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:07.587157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.587832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.588382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.588382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.589104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:07.589409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.590894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.610837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 491/977] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:07.617229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.656376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 487/978] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:07.681817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.731895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a5ea0-54bf-4ea1-a3c6-ee07260a3161 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:07.766253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:07.766970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:07.767183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:07.767395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:07.834498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:07.835856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:07.899058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:07.924097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:07.950564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 492/979] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 15:25:07.954972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.010262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.031706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8c53c-b50d-4257-b5d5-0211944a4334 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.065743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e61c0-6a4f-4be6-a678-a823c491e0f2 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.067230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.067844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.068119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.068382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.068966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.070364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:08.078894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:08.080156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:08.081067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 488/980] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:08.086342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.111297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.111917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.112229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.112454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.122788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.124568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:08.139053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:08.140069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:08.140984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:08.140984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:08.140984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:08.140984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 493/981] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:08.146190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.165770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.200953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5aa63-e492-42ba-8edb-cf1763df07db None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.236906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.237514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.237837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.238108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.238737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.239039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.240405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.250341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 489/982] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:08.251420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.260861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37361d-2bf7-41ca-a9a8-b1a1f01727c7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.264352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.296295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.296892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.297166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.297432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.298089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.298387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.299737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.313009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 494/983] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:08.318788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.360497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f11e6-b1b3-4373-bf03-670cbef4b439 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.395365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.396277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.396710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.397139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.397490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.397993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.398270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.399961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.409722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 490/984] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:08.410732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.434557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002e48b-3789-4cc7-9dae-64c8245e8303 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.470573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.471584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.472069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.472543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.479908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.481562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.490322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:08.496378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:08.497481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:08.498539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:08.505637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 495/985] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:08.506642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.516391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2d23f-c5fd-4c92-8542-79a9d4373355 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.553433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.554068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.554348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.554620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.555319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] RBAC: Adding query filter params (interface=admin, service_id=8138661fb00843df9752e3f6478e9bf4, region_id=RegionOne) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.555626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.556981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.562001 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 491/986] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/endpoints?service_id=8138661fb00843df9752e3f6478e9bf4&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:08.568093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.613947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89d5f3-991a-4f34-ad53-ac4cd7701dda None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.645603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:08.652096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.652768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.653149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.653487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.654363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.654850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.656324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.669207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a367507-9352-40c3-9829-04b7e3b01456 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.670985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 496/987] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:08.677146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:08.710490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.711411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.711828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.712209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.712810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.714985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b97ae-700d-4a71-8cb4-beb30aa5aaf4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.722349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 492/988] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:25:08.787001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9138d-afa5-45c2-ad25-363070fdc737 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:08.823964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:08.824673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:08.825018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:08.825356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:08.826187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] RBAC: Adding query filter params (role.id=08a1d4432bed468ea739453d30bcbe93, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=fd4760e8c6c54b748810f23da3bf3e01) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:08.826563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:08.828075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fa476-1093-48b9-9831-a0b74431ed73 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:08.834944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 497/989] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:08 2022] GET /identity/v3/role_assignments?user.id=fd4760e8c6c54b748810f23da3bf3e01&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=08a1d4432bed468ea739453d30bcbe93 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:09.632209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa255-dba6-4a11-b39c-4362c39cc1c9 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:09.632799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa255-dba6-4a11-b39c-4362c39cc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:09.632799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fa255-dba6-4a11-b39c-4362c39cc1c9 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:09.634292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 493/990] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:09.639378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:09.639667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:09.639945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:09.658772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:09.660302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:09.716295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:09.734924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 498/991] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:09.999412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa255-dba6-4a11-b39c-4362c39cc1c9 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:10.002309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:10.104317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fa255-dba6-4a11-b39c-4362c39cc1c9 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:10.137859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:10.138479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.138758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.139082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.139653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:10.141033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:10.149668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:10.150927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:10.151814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:10.154082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 494/992] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:10.156840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:10.258069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb35d1-ea46-45bc-810b-be0c96b1a6cb None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:10.295681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:10.296276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.296553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.296825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.297441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:10.297763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:10.299119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:10.308846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 499/993] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:10.309981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:10.381713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:10.419220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02012f06-0788-417e-a818-f9d491b23647 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:10.454285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:10.454888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.455167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.455439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.456066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:10.456372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:10.457788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:10.462896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 495/994] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:10.468481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:10.519813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:10.572764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721093c8-79e0-4cc5-bc69-15dc900cf8ce None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:10.606410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:10.607017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.607296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.607567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.608267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] RBAC: Adding query filter params (interface=public, service_id=65cac4d15df44d62b6cb9b4b7bf81a3f, region_id=RegionOne) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:10.608576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:10.609955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa88287-ddd4-4150-b77f-c9545bfcb666 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:10.615759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 500/995] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:25:10 2022] GET /identity/v3/endpoints?service_id=65cac4d15df44d62b6cb9b4b7bf81a3f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:10.621177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:10.729918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0cfbc-49bd-41e4-9d23-8ae7b3ee7635 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:10.759277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:10.766861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:10.767494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.767773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.768046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.768667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:10.770765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c9e93-0157-4fd7-bf87-df1c1f4330aa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:10.778169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 496/996] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:25:10 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:25:10.896952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbdaa-b2d5-4860-ba34-a2a45b3ea7e0 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.897353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbdaa-b2d5-4860-ba34-a2a45b3ea7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.897559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbdaa-b2d5-4860-ba34-a2a45b3ea7e0 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.899202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 501/997] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:10.905436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f5ad-83be-43c7-8a98-d8c7fc664d78 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:10.905815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f5ad-83be-43c7-8a98-d8c7fc664d78 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:10.906026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f5ad-83be-43c7-8a98-d8c7fc664d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:10.926903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-09b9f5ad-83be-43c7-8a98-d8c7fc664d78 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:10.928142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-09b9f5ad-83be-43c7-8a98-d8c7fc664d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:10.999950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 497/998] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:11.021068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d0d8-ab3b-431e-8e1e-8f2c32a11562 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.021330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d0d8-ab3b-431e-8e1e-8f2c32a11562 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.021521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d0d8-ab3b-431e-8e1e-8f2c32a11562 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.023027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 502/999] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:11.028145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.028428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.028696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.047040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:11.048205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:11.115609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 498/1000] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:11.272682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d0d8-ab3b-431e-8e1e-8f2c32a11562 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.375122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d0d8-ab3b-431e-8e1e-8f2c32a11562 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.384634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.390245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:11.413015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.413643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.413951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.414225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.414802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.416162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:11.424693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:11.425713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 15:25:11.426612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:11.430072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 503/1001] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:11.431445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.444739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:11.490487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd94d-6029-4e6a-9eeb-2a23dca76f09 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.524575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.525124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.525656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.525995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] PATH_INFO: `/v3/services/image` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.526561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.527929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:11.536703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:11.541986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:11.542904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 499/1002] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:11.543716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad3598-0000-4b09-981e-6c6ce20a3d3f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.544807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.583991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.585362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.585655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.586006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.586636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:11.586939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.588298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.598910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 504/1003] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:11.600185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.648028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:11.652766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414535e4-9532-4ebc-aee9-e9aaefb31125 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.670061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:11.690755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.691362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.692258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.692531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.693206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] RBAC: Adding query filter params (name=image) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:11.693509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.694994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.700623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 500/1004] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:11.706491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.716756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2613371-1519-4706-8a8a-abeeb5ae2892 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.754787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.755387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.755665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.755933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.756549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:11.756849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.758226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.767857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 505/1005] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:11.768834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:11.813262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cb65-bdd0-4482-ae3a-fdc1eaaef4ac None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.846690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.847285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.847559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.847858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.848474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] RBAC: Adding query filter params (type=image) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:11.848776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.850159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394910-6f8a-4667-9a20-b268a290f42c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.865759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 501/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:11.888550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49693-3c37-4969-96a5-accd6a19d4df None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:11.897346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:11.928769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:11.929390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:11.929666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:11.929961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:11.930637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:11.932086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742150c-d2c5-4af4-840f-4b4c676e8d71 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:11.953468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 506/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:25:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:25:13.026594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937051c0-91bc-4baf-99c1-81e917852250 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:13.027123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937051c0-91bc-4baf-99c1-81e917852250 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:13.027123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937051c0-91bc-4baf-99c1-81e917852250 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:13.028689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 502/1008] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:13.034331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:13.034712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:13.035032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:13.053964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:13.055141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:13.130220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 507/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:13 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:13.397885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937051c0-91bc-4baf-99c1-81e917852250 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:13.445417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:13.500299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937051c0-91bc-4baf-99c1-81e917852250 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:13.533305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:13.533951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:13.534229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:13.534496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:13.535072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:13.536939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:13.545622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:13.546708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 15:25:13.548179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:13.554854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 503/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:13.555014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:13.644465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:13.656234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c779-82d7-4ecc-8bed-76535c7120b7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:13.693366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:13.694025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:13.694303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:13.697397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:13.697397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:13.697397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:13.697397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:13.706238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 508/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:13.707772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:13.810273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300bf2e-5ffd-4b1c-b100-1c9c6c4f9d3e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:13.820820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:13.845393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:13.846025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:13.846302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:13.846572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:13.847192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:13.847491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:13.849421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be95fd0-a968-4410-bf1f-f963498b71d9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:13.858849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 504/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 15:25:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:13.860472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:13.966554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926d3c-3b56-4c82-afc7-26432b2c714e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:14.002798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:14.003427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.003702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.004190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.004770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:14.006209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6f020-54d0-4554-8310-d83e7d98edaf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:14.012964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7895d-b6f5-4cd2-bb65-3d9a392da815 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.013250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7895d-b6f5-4cd2-bb65-3d9a392da815 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.013521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7895d-b6f5-4cd2-bb65-3d9a392da815 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.015073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 505/1013] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:14.021782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.022070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.022345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.037803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 509/1014] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:25:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:25:14.048758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:14.050012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:14.112969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55a5e-993d-43d4-8e65-e26169bc3a60 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.113249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55a5e-993d-43d4-8e65-e26169bc3a60 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.114083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c55a5e-993d-43d4-8e65-e26169bc3a60 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.115724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 510/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:14.121226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.121514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.121794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.134636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 506/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:14.141493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:14.142720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:14.152068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:14.220285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 511/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:14.415925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:14.514281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:14.518230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:14.518680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abaef6-b41d-4df0-90b2-98d80f2d780e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:14.555006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:14.555607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.555910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.556181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.556828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:14.558512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:14.574378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 507/1018] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:25:14 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:14.634933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b03321-a37b-4d28-8685-dfc1e6ad70c2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:14.679211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:14.679878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.680117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.680384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.681499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:14.683002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0bca-b942-44f0-a7a2-cd1e298fea47 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:14.689218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 512/1019] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:14.691141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:14.814293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6e4e-947a-450f-991c-b03d590bd356 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:14.849466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:14.850415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:14.850872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:14.851333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:14.852176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:14.853870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474c25b-72a1-4501-9a04-1561604c346f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:14.881778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 508/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:25:14 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:16.329517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a193-75d9-4893-9f00-3591e8ddaa42 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:16.330109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a193-75d9-4893-9f00-3591e8ddaa42 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:16.330109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a193-75d9-4893-9f00-3591e8ddaa42 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:16.331470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 513/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:16.336709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1a51-c200-45da-a957-c9c73275f711 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:16.337087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1a51-c200-45da-a957-c9c73275f711 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:16.337267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b1a51-c200-45da-a957-c9c73275f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:16.354961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b19b1a51-c200-45da-a957-c9c73275f711 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:16.356139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b19b1a51-c200-45da-a957-c9c73275f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:16.364052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:16.431161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 509/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:16.705831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a193-75d9-4893-9f00-3591e8ddaa42 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:16.718006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:16.747423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3842-d0c7-4c0f-86bb-978ba6f1f0a4 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:16.747710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3842-d0c7-4c0f-86bb-978ba6f1f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:16.747984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace3842-d0c7-4c0f-86bb-978ba6f1f0a4 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:16.749323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 510/1023] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:16.755392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:16.755681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:16.755958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:16.775809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:16.776991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:16.828979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a193-75d9-4893-9f00-3591e8ddaa42 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:16.846888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 511/1024] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:16.866727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:16.867353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:16.867631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:16.867902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:16.878173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:16.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:16.883949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:16.884821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:16.889137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 514/1025] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:25:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:16.890012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:16.961167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:16.995743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1e8a-a5f0-45fb-a9e4-1fb087cf0aba None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.031878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.032299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.032575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.032844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.033514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.033848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.035862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f335eaa-76d2-4988-a7b5-c0ceb2f908f2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.048936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 512/1026] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:25:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.050852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.099774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37b62-137a-4b95-b63d-a6e97480b82d None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.100061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37b62-137a-4b95-b63d-a6e97480b82d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.100329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37b62-137a-4b95-b63d-a6e97480b82d None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.101661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 513/1027] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:25:17.106523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.106809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.107086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.119922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.124982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:17.126203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:17.154648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddd26c-5aaf-475b-934e-54e7f77a968b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.188715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.189341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.189622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.189922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.192515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 514/1028] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:17.193345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.200577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.202049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:17.217569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:17.218841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:17.219964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:17.219964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:17.219964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:17.223547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 515/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:17.224274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.264651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.308318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687a564-ec7c-4cf6-a03a-29d0d4eb3edb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.325076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb939864-25a5-445e-b451-3d84aceae694 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.342947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.344129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.344829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.345059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.345413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.346519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.348299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:17.357500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:17.358530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:17.359393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 515/1030] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:17.363861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.364575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.364866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.365820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.366155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.366989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.367354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.368727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.385973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 516/1031] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:17.387006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.475784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfca3e-6505-466e-8826-8a583714fbb5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.490381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebc962-f78b-4a09-a401-7dee0aa5a9be None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.500225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.508654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.509248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.509525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.509818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.510440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] RBAC: Adding query filter params (name=image) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.510743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.512096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.516841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 516/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.517781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.525235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.526165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.526447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.526718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.533686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.535180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:17.546570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:17.547659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:17.548647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 517/1033] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:17.549293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.588605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.620133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11650-4be6-4899-a8f0-3317d0aec7ef None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.647058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497287-faff-46f8-8818-94735578fe40 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.652691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.653301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.653575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.653872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.654964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.656383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.657942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 517/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.658684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.682496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.683210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.683549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.683892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.684588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.684976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.686377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.691147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 518/1035] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.692452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.718118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.758989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8fbd-0bb4-4bd1-a089-6f34204068c6 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.791462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.792052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.792331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.792598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.793305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.793608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.794076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5aba0-1646-4117-abcd-7bf7466c55fb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.795049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.795690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.812903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 518/1036] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.813705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.834674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.835278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.835559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.835836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.836477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.837925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.858728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 519/1037] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:25:17 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:17.859538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.928130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd482a-d128-47c4-8dd0-05bfc1eee270 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:17.946959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:17.965238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:17.965886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:17.966166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:17.966436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:17.967149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] RBAC: Adding query filter params (interface=public, service_id=ff7a1e8c0b4745b69f050d2e555ccc21, region_id=RegionOne) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:17.967454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:17.969015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:17.979852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 519/1038] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/endpoints?service_id=ff7a1e8c0b4745b69f050d2e555ccc21&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:17.981006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:17.985470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c69e1-e1d1-4df7-9212-73506ab64841 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.022615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.023146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.023426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.023703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.055087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:18.095711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a765a-a086-4e5b-818b-346c8804fe47 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.108474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.109952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.131259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.131864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.132198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.132478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.133080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.134465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.141052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 520/1039] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:25:18.220847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 520/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:17 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:18.227610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:18.278869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:18.338525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0aba9-6425-4384-bf18-4d023b7d2ded None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.374052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.374723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.374951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.375204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.385326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.386875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:18.402202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:18.403178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:18.404077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:18.404077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:18.404077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:18.404077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 521/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:18.409007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:18.467286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:18.510271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20da2e7-ba58-4259-b3bb-0f06e2dd73cf None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.544042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.544489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.544758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.545088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.545737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:18.546053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.547394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.559246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 521/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:18.564556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:18.669467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:18.673911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195936-8cc6-4dc3-8ab1-5842e968ac73 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.716854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.717480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.717810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.718050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.724597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.726062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:18.737068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:18.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:18.739198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 522/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:18.745679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:18.846527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143f48-e6cc-4603-b8fc-d1b367fb8b33 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:18.863698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:18.881452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:18.882343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:18.882846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:18.883314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:18.884173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:18.884650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:18.886335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500b1c-ced3-4c2b-8be0-421f7c512b28 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:18.899005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 522/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:18.904878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:19.003664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9f5b3-1ed1-4a72-9b45-21f98828847b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:19.037485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:19.038138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:19.038413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:19.038682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:19.039423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] RBAC: Adding query filter params (role.id=08a1d4432bed468ea739453d30bcbe93, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:19.039727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:19.041196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0dfcc-7802-4d0d-a67a-8544017b3a06 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:19.047719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 523/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:18 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=08a1d4432bed468ea739453d30bcbe93 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:20.070283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d124-dbff-4d2d-97cf-1f286a805903 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.070812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d124-dbff-4d2d-97cf-1f286a805903 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.070812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197d124-dbff-4d2d-97cf-1f286a805903 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.072196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 523/1046] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:20.077232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb6e0-bcf4-4eac-98aa-316a1b1f4e55 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.077620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb6e0-bcf4-4eac-98aa-316a1b1f4e55 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.077818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb6e0-bcf4-4eac-98aa-316a1b1f4e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.096872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9dedb6e0-bcf4-4eac-98aa-316a1b1f4e55 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:20.098635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9dedb6e0-bcf4-4eac-98aa-316a1b1f4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:20.115516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:20.169774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 524/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:20.334551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63b55-9542-484d-9cca-fd13c1dd4946 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.334875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63b55-9542-484d-9cca-fd13c1dd4946 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.335043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c63b55-9542-484d-9cca-fd13c1dd4946 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.336503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 524/1048] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:20.341620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.341933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.342208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.360037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:20.361205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:20.429767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 525/1049] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:20.438780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63b55-9542-484d-9cca-fd13c1dd4946 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.542157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c63b55-9542-484d-9cca-fd13c1dd4946 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:20.575673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:20.576293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.576573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.576843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.587313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:20.591980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:20.592916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:20.593806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:20.598038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 525/1050] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:20.599192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.682218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:20.703716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.707671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f413f21-6479-4f42-b19f-85c02fbbb415 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:20.743614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:20.744151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:20.744265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.744487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.744759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.745419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:20.745765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:20.747323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:20.757411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 526/1051] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:20.763215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.814897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93259a13-ca96-468c-828b-876e3e1a489b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:20.852003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:20.852546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.852826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.853103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.853675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:20.855309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:20.863182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15625afc-79b8-4850-a6a1-18a717998277 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:20.864561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:20.865625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:20.866498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 526/1052] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:20.871442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.901383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:20.902091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:20.902371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:20.902698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] PATH_INFO: `/v3/users/f85d165f58624e0a94504e47af5858e4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:20.917438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] RBAC: Authorizing `identity:get_user(user_id=f85d165f58624e0a94504e47af5858e4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:20.918929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:20.925762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 527/1053] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/users/f85d165f58624e0a94504e47af5858e4 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:20.926523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:20.929043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:20.975448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4116710-f8e2-4330-a110-de128d90c8f0 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:20.977080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.011170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.011787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.012040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.012309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.012923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] RBAC: Adding query filter params (name=image) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:21.013223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.014630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.024660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 527/1054] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:21.026042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.030991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb59530-8e4a-41d0-8863-88aa0f88c3ba None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.068816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.069430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.069708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.070009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.139170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e37d3-40b5-44ef-b429-87f706dca764 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.142284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.143736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85a8ee-5891-4064-b9ae-6b5abe7f4e48 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.145673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.174653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.175259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.175538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.176441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.177062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] RBAC: Adding query filter params (type=image) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:21.177365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.178770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b5558-d41c-4198-be2d-c255c44cb250 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.183610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 528/1055] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:21.184757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f924b-150f-4983-ae27-0cb5342a75b2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.185042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f924b-150f-4983-ae27-0cb5342a75b2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.185313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f924b-150f-4983-ae27-0cb5342a75b2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.186539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 529/1056] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:21.190610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f924b-150f-4983-ae27-0cb5342a75b2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.222467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.246299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 528/1057] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 15:25:21.247865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.248163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.248556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.265541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:21.266739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:21.299337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f924b-150f-4983-ae27-0cb5342a75b2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.331030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 529/1058] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:21.332328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.333833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.334433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.334714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.334985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.335651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.336997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.361898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 530/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:25:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:21.377071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.437069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a623c-8a5b-4440-a609-dcdb0754894b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.479946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.480590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.480926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.481120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.482453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.483933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.485942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 530/1060] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:21.493382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.584766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.600542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222190-9265-4fb1-adbb-58e75c205f7e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.611607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.635295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.636296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.636579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.636854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.637585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9, user.id=f85d165f58624e0a94504e47af5858e4) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:21.637934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.639798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.647587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 531/1061] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/role_assignments?user.id=f85d165f58624e0a94504e47af5858e4&scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:21.723232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:21.730118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fdf2-c9da-480c-a23d-bce5b6a98c08 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.768667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.769310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.769626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.769921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.781788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:21.787302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:21.788328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:21.790718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 531/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:21.794840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:21.901525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff38f9-83eb-4413-b1d7-d7c81b149569 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:21.935074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:21.935683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:21.935965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:21.936237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:21.936898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:21.937202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:21.938591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:21.947309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 532/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:21.952846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.054834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249087-2e78-4d40-a5cd-41ab61ed9c49 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.088831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.089459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.089758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.090035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.100272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.101723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:22.116706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:22.117674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:22.118626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:22.118626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:22.118626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:22.118626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 532/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:22.124604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.141060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:22.226388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004a2d6-8980-4546-bcde-6b0177960293 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.260402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.260997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.261271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.261537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.262193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:22.262497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.263836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.276253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 533/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:22.281819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.298735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:22.389191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a179c-ef32-4d24-be67-fb457cc2cb5a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.423245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.423866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.424143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.424414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.431714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.433149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:22.444665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:22.445590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:22.451483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 533/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:22.452160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.522367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:22.554543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5ccb-90a4-4ec6-b4af-563717e05789 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.589885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.590537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.590812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.591136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.591820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:22.592143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.593542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.611484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 534/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:22.617699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.686692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:22.723516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3785fc0-ddbd-42ff-90c6-25ff987128f3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.756050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.756663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.756935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.757198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.767259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.768675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:22.783785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:22.784745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:22.786292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:22.786292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:22.786292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:22.787021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 534/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:22.791112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:22.888860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d79106-8af0-467a-8f63-47a475c81a47 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:22.919223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:22.926312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:22.926921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:22.927201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:22.927474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:22.928116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:22.928422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:22.929804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:22.941529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 535/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:22.947132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:23.048384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b1aa-1873-45b7-b612-3316b939a5f7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:23.068122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:23.084188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:23.084819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.085099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.085372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.092079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:23.093518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:23.105138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:23.106040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:23.106932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:23.110098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 535/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:23.112141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:23.214705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044a25-32eb-41e7-b3ef-81dcf8e653de None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:23.247210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:23.247811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.248090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.248357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.249028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:23.249329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:23.250760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a88a4e-5458-410a-b653-3a66da0b2e94 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:23.263314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 536/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:23.269073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:23.368181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05016c-d3d6-4c9d-9a70-401ace3926aa None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:23.401656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:23.402337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.402612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.402882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/08a1d4432bed468ea739453d30bcbe93` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.404973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=2ce045e8077e433ba889e189fb1c690b, role_id=08a1d4432bed468ea739453d30bcbe93)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:23.406420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1543ace-46b8-4fba-9386-2d34cc7c361e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:23.419811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 536/1072] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:25:23 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/2ce045e8077e433ba889e189fb1c690b/roles/08a1d4432bed468ea739453d30bcbe93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:25:23.572782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6a5e-7d88-4fa1-93cc-f736811e3278 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.572986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6a5e-7d88-4fa1-93cc-f736811e3278 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.573240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6a5e-7d88-4fa1-93cc-f736811e3278 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.574839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 537/1073] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:23.580255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e8b2-f5ab-4761-b718-c20779f5c555 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.580535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e8b2-f5ab-4761-b718-c20779f5c555 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.580867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513e8b2-f5ab-4761-b718-c20779f5c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.599672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e513e8b2-f5ab-4761-b718-c20779f5c555 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:23.600851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e513e8b2-f5ab-4761-b718-c20779f5c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:23.638398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:23.674642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 537/1074] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:23.839595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bea49-b982-4d9a-995a-e5facb41d707 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.839964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bea49-b982-4d9a-995a-e5facb41d707 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.840068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bea49-b982-4d9a-995a-e5facb41d707 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.841627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 538/1075] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:23.846874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:23.847221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:23.848082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:23.866294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:23.867440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:23.937769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 538/1076] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:23.942940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bea49-b982-4d9a-995a-e5facb41d707 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:23.993014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.043507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bea49-b982-4d9a-995a-e5facb41d707 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.076820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.077418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.077697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.077993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.144995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.146397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.194344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.217416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.250663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 539/1077] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 15:25:24.256406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.326613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.330698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6473bd-8b52-465f-89bb-51ac696e74d2 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.359536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55d777-4f5a-4f03-9a15-f01b909a8bf7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.367594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.368477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.369448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.369923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.381325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:24.387005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:24.388157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:24.389331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:24.391859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 539/1078] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:24.393539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.394188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.394980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.395299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.398297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.407225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.408756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:24.423504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:24.424430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:24.425351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:24.425351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:24.425351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:24.425351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 540/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:24.431042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.433600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.509803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734505c-21cc-4588-a9d8-62ec0d0f3355 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.536529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56476c73-3e2e-47bc-9b36-adc19da19332 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.545812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.546345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.546619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.546894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.547549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:24.548047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.549197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.558033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 540/1080] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:24.563662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.577743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.578410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.578699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.578972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.579609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:24.579918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.581332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.588741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.602157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 541/1081] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:24.671916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a11f1a-bf62-43b4-ae19-fefb93abe18e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.716667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.717312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.717591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.717908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] PATH_INFO: `/v3/users/f85d165f58624e0a94504e47af5858e4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.719086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] RBAC: Authorizing `identity:get_user(user_id=f85d165f58624e0a94504e47af5858e4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.720545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.722488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 541/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/users/f85d165f58624e0a94504e47af5858e4 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:24.728278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.794819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.837061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299ef4-8d95-405f-b574-60f7732371ed None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:24.875535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:24.876166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:24.876449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:24.876721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:24.877897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:24.879887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30e3c-ef12-4eb7-8eeb-c6fc068bf6aa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:24.881753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 542/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:24 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:24.888430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:24.979429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:24.989708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7f81e-b553-4450-999b-dcc1abc7b5de None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:25.022292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:25.022934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:25.023212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:25.023483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9/users/f85d165f58624e0a94504e47af5858e4/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:25.025354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] RBAC: Authorizing `identity:create_grant(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9, user_id=f85d165f58624e0a94504e47af5858e4, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:25.027070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddf286-a680-45ac-9ba8-7aa5bc070d38 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:25.040311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 542/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:25:24 2022] PUT /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9/users/f85d165f58624e0a94504e47af5858e4/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:25:25.576520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb07a-794d-4895-88b0-7566b5d96834 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:25.577074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb07a-794d-4895-88b0-7566b5d96834 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:25.577074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fb07a-794d-4895-88b0-7566b5d96834 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:25.578410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 543/1085] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:25.583979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:25.584388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:25.584525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:25.603406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:25.604584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:25.668763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 543/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:25.939096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fb07a-794d-4895-88b0-7566b5d96834 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.035121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fb07a-794d-4895-88b0-7566b5d96834 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.061883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:26.068255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.068862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.069134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.069402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.079112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:26.083795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:26.084920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:26.085820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 544/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 15:25:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:26.090863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.167712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:26.186991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7870-9bf7-4d59-8e1e-5af37704d1c8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.218684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.219277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.219555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.219819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.220463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:26.220763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:26.222143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:26.230316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 544/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:26.236038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.334150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb9ae-320b-48a5-a32a-708a73ee7bb7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.366991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.367600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.367875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.368143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.377708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:26.379218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:26.393109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:26.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:26.395282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:26.395282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:26.395282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:26.395282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 545/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:26.399943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.497946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90ef2c-46a2-475b-9b6c-c1facfbe162c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.529905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.530491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.530764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.531030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.531650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:26.531948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:26.533294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:26.544668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 545/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:26.550211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.592080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:26.647236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeeae8-d6b3-49e9-b80f-a1b7c204609c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.679148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.679764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.680038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.680305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.689696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:26.691793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:25:26.703061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:26.704174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 15:25:26.705329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:26.709076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 546/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:26.710036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.712964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:26.809809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9374c2-49c5-4873-bb88-48d7b5b88897 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.842589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:26.843180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:26.843452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:26.843716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:26.844419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:26.844717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:26.846157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:26.862536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 546/1092] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:26.868778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:26.966569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42cfc-0d41-439a-a35a-88258201fd6f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:26.968058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:26.999886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.000484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.000759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.001023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.068471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.074133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2821-d370-440d-9a51-1d6a4cdc6139 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.175535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 547/1093] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:27.181379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.194649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8243-2627-4578-a103-0d43892eaed0 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.194930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8243-2627-4578-a103-0d43892eaed0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.195198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae8243-2627-4578-a103-0d43892eaed0 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.196500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 548/1094] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:27.201870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.202148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.202413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.209457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.223728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:27.224927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:27.239954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.281748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1abe6c-62fe-414b-b532-3b6181f3560c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.291064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 549/1095] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:25:27.320820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.321361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.321634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.321924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.331928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.333365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:25:27.348149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:27.349274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:25:27.350234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:25:27.350234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:25:27.350234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:27.350234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 547/1096] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:27.355026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.452808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23044f-0239-4a75-9ccb-8b69b66b81fd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.481237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.487014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.487669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.488460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.488737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.489368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:27.489671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.491330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.502896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 550/1097] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:27.509493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.555994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.610382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31670854-a6ea-4623-a7e4-fa83bce2340f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.622951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.644627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.645267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.645538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.645830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.652442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.653900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.657558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73d907-7e1e-4f54-be0b-39828836b12b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:25:27.665254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:27.666418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:27.667319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 548/1098] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:27.672035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.693674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.694342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.694626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.694900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.705833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:27.711569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:27.712508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:27.713802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 551/1099] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:25:27.718487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.768216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.771900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d7466-c64c-46d9-a97c-bf0d90ea4487 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.804302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.804899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.805407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.805682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.806394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:27.806704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.808124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.815670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5fd0a-83a6-4e94-97cb-b856fb9a7203 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.820340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 549/1100] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:27.826323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.849598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.850236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.850720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.850863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.851498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:27.851904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.853335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.857003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:27.863637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 552/1101] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:27.869398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:27.924744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf81f5-2857-4383-b4f6-85cbfded0474 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.957802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:27.958424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:27.958723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:27.958993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:27.959706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] RBAC: Adding query filter params (role.id=08a1d4432bed468ea739453d30bcbe93, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=2ce045e8077e433ba889e189fb1c690b) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:27.960011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:27.961428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:27.967128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 550/1102] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/role_assignments?user.id=2ce045e8077e433ba889e189fb1c690b&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=08a1d4432bed468ea739453d30bcbe93 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:27.967524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984a976-e10a-44dc-927c-57ee175e1d98 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:27.982994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:28.005028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:28.005675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:28.005982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:28.006256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] PATH_INFO: `/v3/users/f85d165f58624e0a94504e47af5858e4` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:28.007463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] RBAC: Authorizing `identity:get_user(user_id=f85d165f58624e0a94504e47af5858e4)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:28.008914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:28.010566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 553/1103] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:27 2022] GET /identity/v3/users/f85d165f58624e0a94504e47af5858e4 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:28.016407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:28.121988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:28.128524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dafd56-6f35-44fe-941a-916a7627b9f7 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:28.165396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:28.166048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:28.166335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:28.166602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:28.233685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:28.235166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:28.328601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:28.336061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 551/1104] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:28.342276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:28.449708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7c85-0b52-4ca0-9f1b-899ec3957db8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:28.485184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:28.485844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:28.486115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:28.486381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:28.487480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:28.488924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda02e7-180a-454e-a735-396f3de255b3 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:28.490581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 554/1105] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:28 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:28.496813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:28.597271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e83cc-abc6-4efc-8e50-3ea0a0429de4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:28.631031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:28.631627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:28.631902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:28.632169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:28.632878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9, user.id=f85d165f58624e0a94504e47af5858e4) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:28.633179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:28.634612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696d9f-b564-4b10-9a0e-45ca8377282a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:28.640363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 552/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:28 2022] GET /identity/v3/role_assignments?user.id=f85d165f58624e0a94504e47af5858e4&scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:30.880557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3c5e-ec7d-45d6-bcca-0fd3f9c6a360 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:30.881106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3c5e-ec7d-45d6-bcca-0fd3f9c6a360 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:30.881106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c3c5e-ec7d-45d6-bcca-0fd3f9c6a360 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:30.882509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 555/1107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:30.887809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:30.888196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:30.888353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:30.906882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:30.908046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:30.961378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:30.974032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 553/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:31.250474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c3c5e-ec7d-45d6-bcca-0fd3f9c6a360 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:31.299008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:31.346784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c3c5e-ec7d-45d6-bcca-0fd3f9c6a360 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:31.381326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:31.382055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:31.382388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:31.382673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:31.383908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:31.385590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fafbe-ebb0-4373-9455-483cdff1127a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:31.387281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 556/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:31.394356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:31.490316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf2db6-91e1-4e56-b98f-e874a2f95bae None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:31.522356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:31.522890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:31.523169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:31.523440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:31.524095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:31.525518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ff489-e162-471a-9bcb-ddfff73f0671 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:31.546770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 554/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:25:31 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:25:33.861573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1122-bb04-438f-b64a-0448cf70b466 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:33.862148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1122-bb04-438f-b64a-0448cf70b466 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:33.862148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae1122-bb04-438f-b64a-0448cf70b466 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:33.864091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 557/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:33.869221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:33.869679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:33.869820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:33.887309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:33.888474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:33.929432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:33.954471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 555/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:34.228562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae1122-bb04-438f-b64a-0448cf70b466 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:34.329887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae1122-bb04-438f-b64a-0448cf70b466 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:34.349560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:34.366216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:34.366825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:34.367096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:34.367410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] PATH_INFO: `/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:34.368884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] RBAC: Authorizing `identity:get_role(role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:34.370446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:34.371872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 558/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:34 2022] GET /identity/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:34.378471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:34.474642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98f546-a6d7-4706-b724-b38c75ae9f2b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:34.507262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:34.507805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:34.508083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:34.508353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] PATH_INFO: `/v3/users/17d462bf2e12447ba6750b7533303e52` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:34.521464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] RBAC: Authorizing `identity:get_user(user_id=17d462bf2e12447ba6750b7533303e52)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:34.522929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:34.524487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 556/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:34 2022] GET /identity/v3/users/17d462bf2e12447ba6750b7533303e52 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:25:34.530651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:34.624955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764ee4-e097-4942-9740-b4bcad68e9dc None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:34.656494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:34.657073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:34.657346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:34.657612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:34.709438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:34.723245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:34.724691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:34.817870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 559/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:34.823614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:34.856936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:34.920906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1f248-155f-4af9-91f5-b3940eb88f12 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:34.953013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:34.953621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:34.953932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:34.954207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:34.955308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:34.957257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbabf6d-19c9-4943-a473-cde46439b7bd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:34.958885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 557/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:34 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:34.964779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:35.045229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:35.059652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732c93-35d1-4b84-a854-cf4bfb122730 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:35.091988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775d945-8350-4757-b1a3-411472750450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:35.092585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775d945-8350-4757-b1a3-411472750450 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:35.092870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775d945-8350-4757-b1a3-411472750450 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:35.093145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775d945-8350-4757-b1a3-411472750450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:35.093887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775d945-8350-4757-b1a3-411472750450 None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9, user.id=17d462bf2e12447ba6750b7533303e52) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:35.094197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775d945-8350-4757-b1a3-411472750450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:35.095612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775d945-8350-4757-b1a3-411472750450 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:35.101315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 560/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:34 2022] GET /identity/v3/role_assignments?user.id=17d462bf2e12447ba6750b7533303e52&scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:37.171715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c132-75be-4608-a9cb-ae3f96d18448 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:37.172242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c132-75be-4608-a9cb-ae3f96d18448 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:37.172242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c132-75be-4608-a9cb-ae3f96d18448 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:37.173572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 558/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:37.179328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:37.179732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:37.179873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:37.198065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:37.199234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:37.263052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 561/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:37.529307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c132-75be-4608-a9cb-ae3f96d18448 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:37.628361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c132-75be-4608-a9cb-ae3f96d18448 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:37.629855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:37.662278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:37.662884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:37.663155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:37.663420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] PATH_INFO: `/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:37.664773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] RBAC: Authorizing `identity:get_role(role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:37.666160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:37.667438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 559/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:37 2022] GET /identity/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:37.673074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:37.749465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:37.767711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d15c0-80af-41ac-81cb-c149c44c9c5c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:37.800407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:37.800981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:37.801281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:37.801546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] PATH_INFO: `/v3/users/17d462bf2e12447ba6750b7533303e52` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:37.802661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] RBAC: Authorizing `identity:get_user(user_id=17d462bf2e12447ba6750b7533303e52)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:37.804072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:37.805609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 562/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:37 2022] GET /identity/v3/users/17d462bf2e12447ba6750b7533303e52 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:37.811356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:37.907184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65302bee-f3b5-4273-824e-80c4eb89c92d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:37.939546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:37.940151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:37.940427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:37.940698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:37.942369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:37.943782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d63262-b2bc-4d9c-8882-dfb3ee2bf396 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:37.945361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 560/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:37 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:37.951057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:38.044559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0c4f-6662-4139-a00f-397632403941 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:38.076801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:38.077370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:38.077644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:38.077939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9/users/17d462bf2e12447ba6750b7533303e52/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:38.080016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] RBAC: Authorizing `identity:create_grant(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9, user_id=17d462bf2e12447ba6750b7533303e52, role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:38.081404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd10d4e2-a389-4022-80b1-3723946e5cda None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:38.093900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 563/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:25:37 2022] PUT /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9/users/17d462bf2e12447ba6750b7533303e52/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:25:40.235086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d182-d308-4f07-af4b-cc64981fcffb None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:40.235641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d182-d308-4f07-af4b-cc64981fcffb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:40.235641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d182-d308-4f07-af4b-cc64981fcffb None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:40.236956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 561/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:40.242584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:40.242986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:40.243126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:40.260889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:40.262112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:40.264027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:40.328021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 564/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:40.603910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d182-d308-4f07-af4b-cc64981fcffb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:40.643485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:40.702828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d182-d308-4f07-af4b-cc64981fcffb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:40.735680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:40.736309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:40.736572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:40.736841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] PATH_INFO: `/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:40.738836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] RBAC: Authorizing `identity:get_role(role_id=a1c50bb7d6bc42e18703a2578363cc6a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:40.740180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:40.741471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 562/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:40 2022] GET /identity/v3/roles/a1c50bb7d6bc42e18703a2578363cc6a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:40.747854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:40.841519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa3488-88f8-4b6a-aab7-18e38961c5bc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:40.873697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:40.874269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:40.874540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:40.874810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] PATH_INFO: `/v3/users/17d462bf2e12447ba6750b7533303e52` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:40.875886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] RBAC: Authorizing `identity:get_user(user_id=17d462bf2e12447ba6750b7533303e52)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:40.877292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:40.878889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 565/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:40 2022] GET /identity/v3/users/17d462bf2e12447ba6750b7533303e52 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:40.884627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:40.980216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebecf8b-e0af-423a-9b05-804a9b15cb6c None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:40.987120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:41.012831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:41.013412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:41.013687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:41.013986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:41.077342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:41.078797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:41.172570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 563/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:41.178342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:41.186821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:41.273341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb7f04-3932-4f5c-9669-73c790e5a5da None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:41.304665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:41.305265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:41.305539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:41.305834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] PATH_INFO: `/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:41.306909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] RBAC: Authorizing `identity:get_project(project_id=e01e73ec487a4a9b96a8b54e1f4c84f9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:41.308306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499b9ea-fc3a-4fda-8e2a-b873eaac9e52 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:41.309898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 566/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:41 2022] GET /identity/v3/projects/e01e73ec487a4a9b96a8b54e1f4c84f9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:41.316437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:41.324206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:41.411473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b7412-0df8-49ad-a5fa-1fb470dd32ef None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:41.444224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:41.444778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:41.445055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:41.445324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:41.446061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] RBAC: Adding query filter params (role.id=a1c50bb7d6bc42e18703a2578363cc6a, scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9, user.id=17d462bf2e12447ba6750b7533303e52) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:41.446364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:41.447763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acbc6e-56f7-400b-97c2-74654b95c7ad None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:41.453316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 564/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:41 2022] GET /identity/v3/role_assignments?user.id=17d462bf2e12447ba6750b7533303e52&scope.project.id=e01e73ec487a4a9b96a8b54e1f4c84f9&role.id=a1c50bb7d6bc42e18703a2578363cc6a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:43.582990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f142-c764-4408-98ac-f8530508b0c3 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:43.583550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f142-c764-4408-98ac-f8530508b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:43.583550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070f142-c764-4408-98ac-f8530508b0c3 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:43.584988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 567/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:43.590337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:43.590758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:43.590878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:43.608353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:43.609513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:43.668752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:43.673448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 565/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:43.968371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f142-c764-4408-98ac-f8530508b0c3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:44.041022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:44.066442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070f142-c764-4408-98ac-f8530508b0c3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:44.098011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570c328-4267-492e-8712-91072c914382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:44.098613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c328-4267-492e-8712-91072c914382 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:44.098886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c328-4267-492e-8712-91072c914382 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:44.099151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c328-4267-492e-8712-91072c914382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:44.100224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c328-4267-492e-8712-91072c914382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:44.101630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c328-4267-492e-8712-91072c914382 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:44.103166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 568/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:44.108875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:44.204339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d377a-e8de-4b0c-9121-01cca1c4804e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:44.236933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:44.237466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:44.238295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:44.238565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:44.239199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:44.240615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e2de8-708f-4ff8-b291-9f6901d2f9ac None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:44.266177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 566/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:25:44 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:46.403705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accae3-d5be-4701-95b0-21fa5523e3b4 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:46.404268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accae3-d5be-4701-95b0-21fa5523e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:46.404268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26accae3-d5be-4701-95b0-21fa5523e3b4 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:46.405562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 569/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:46.411173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:46.411696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:46.411792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:46.430384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:46.431567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:46.476361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:46.496716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 567/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:46.763185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26accae3-d5be-4701-95b0-21fa5523e3b4 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:46.859809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26accae3-d5be-4701-95b0-21fa5523e3b4 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:46.892007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:46.892604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:46.892877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:46.893142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:46.894736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:46.896135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24f7c8-02c9-4e14-afa5-3373f0885f02 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:46.897641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 570/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:46.903420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:46.999213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038a439-1aea-4563-90aa-04d0f8869706 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:47.032603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:47.033289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:47.033611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:47.033988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:47.035261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:47.037008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ccb0a-e9bb-424a-a265-4972a094e897 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:47.057838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 568/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:25:46 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:25:49.255827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6c63-bd78-488b-88c0-3978d5c32300 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:49.256360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6c63-bd78-488b-88c0-3978d5c32300 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:49.256360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6c63-bd78-488b-88c0-3978d5c32300 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:49.257683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 571/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:49.262829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:49.263203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:49.263390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:49.282606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:49.283862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:49.313252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:49.352113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 569/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:49.621620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6c63-bd78-488b-88c0-3978d5c32300 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:49.634125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:49.721686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6c63-bd78-488b-88c0-3978d5c32300 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:49.754154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:49.754768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:49.755046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:49.755317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:49.764978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:49.770284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:49.771327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:49.772224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 572/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:49.777628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:49.875670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d32237-8d44-4c55-bc4b-f6d5c5348b28 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:49.908375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:49.908966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:49.909246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:49.909543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:49.910225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:49.910528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:49.911890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:49.919582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 570/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:49.925997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:49.991899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:50.022132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7e10-404b-4622-908c-655981d9c166 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:50.054996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:50.055602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:50.055881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:50.056153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] PATH_INFO: `/v3/users/98dea98d0bbb425c87dfedb01fb6331a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:50.069310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] RBAC: Authorizing `identity:get_user(user_id=98dea98d0bbb425c87dfedb01fb6331a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:50.070760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:50.072318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 573/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:49 2022] GET /identity/v3/users/98dea98d0bbb425c87dfedb01fb6331a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:50.077952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:50.107411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:50.174459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216f41-dc93-47d1-86bc-76c3d125268e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:50.206176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:50.206758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:50.207030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:50.207300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:50.270809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:50.272223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:50.299789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:50.365937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 571/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:50.371782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:50.466031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370ed54-7037-4c7c-a511-0776f6d70b20 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:50.491610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:50.499190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:50.499796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:50.500069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:50.500336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] PATH_INFO: `/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:50.501417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=746a16a00e0f4e48ad6ac054aacf82ce)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:50.502858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477b3c-c0e8-450d-b2d3-83cb12007fd8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:50.504480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 574/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:50 2022] GET /identity/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:50.510538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:50.605296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd5f-fea4-4d81-8ee7-29b2a9e6f0bc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:50.632627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:50.638598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:50.639180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:50.639454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:50.639718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:50.640416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=746a16a00e0f4e48ad6ac054aacf82ce, user.id=98dea98d0bbb425c87dfedb01fb6331a) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:50.640715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:50.642155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d56ab6-2bab-4fd3-9c9f-3ad37c28dd51 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:50.647820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 572/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:50 2022] GET /identity/v3/role_assignments?user.id=98dea98d0bbb425c87dfedb01fb6331a&scope.project.id=746a16a00e0f4e48ad6ac054aacf82ce&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:52.772957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce98-1b16-4415-9971-863efd7102cb None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:52.773529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce98-1b16-4415-9971-863efd7102cb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:52.773529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539ce98-1b16-4415-9971-863efd7102cb None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:52.774882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 575/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:52.780096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:52.780544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:52.780665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:52.798825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:52.799988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:52.864359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 573/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:53.134407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539ce98-1b16-4415-9971-863efd7102cb None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:53.233064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539ce98-1b16-4415-9971-863efd7102cb None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:53.266319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:53.266923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:53.267199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:53.267466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:53.277934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:53.282589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:53.283794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:25:53.285128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 576/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:53.289436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:53.385476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b206f4-2d52-4444-a898-57fe94f45534 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:53.410129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:53.420548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:53.421134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:53.421410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:53.421678 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:53.422360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:53.422660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:53.424013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:53.431794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 574/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:53.437456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:53.492040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:53.534424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9c96-4381-4350-b110-aba66d9cb49b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:53.567416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:53.568034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:53.568308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:53.568574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] PATH_INFO: `/v3/users/98dea98d0bbb425c87dfedb01fb6331a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:53.569651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] RBAC: Authorizing `identity:get_user(user_id=98dea98d0bbb425c87dfedb01fb6331a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:53.571079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:53.572604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 577/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:53 2022] GET /identity/v3/users/98dea98d0bbb425c87dfedb01fb6331a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:53.578149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:53.672696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a6b43-3a29-4ac4-9266-6c9e49ad555d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:53.707968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:53.708581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:53.708853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:53.709120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] PATH_INFO: `/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:53.710238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] RBAC: Authorizing `identity:get_project(project_id=746a16a00e0f4e48ad6ac054aacf82ce)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:53.711645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498836ec-554f-40a7-8493-c4be35a962a0 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:53.713232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 575/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:53 2022] GET /identity/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:53.719196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:53.816252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccec0d-3606-4932-8b8e-763026194d93 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:53.838411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:53.849232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:53.849907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:53.850180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:53.850447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] PATH_INFO: `/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce/users/98dea98d0bbb425c87dfedb01fb6331a/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:53.852321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] RBAC: Authorizing `identity:create_grant(project_id=746a16a00e0f4e48ad6ac054aacf82ce, user_id=98dea98d0bbb425c87dfedb01fb6331a, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:53.853720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b357cf1-c328-4800-9573-4ba5d374c925 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:53.866387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 578/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:25:53 2022] PUT /identity/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce/users/98dea98d0bbb425c87dfedb01fb6331a/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:25:55.958521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ffaff-af74-44a3-ba04-31da3d463fdf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:55.959056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ffaff-af74-44a3-ba04-31da3d463fdf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:55.959056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ffaff-af74-44a3-ba04-31da3d463fdf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:55.960292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 576/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:55.965436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:55.965884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:55.965989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:55.983676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:55.984849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:56.048185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 579/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:56.310764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ffaff-af74-44a3-ba04-31da3d463fdf None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:56.365129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:56.410372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ffaff-af74-44a3-ba04-31da3d463fdf None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:56.442005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:56.442607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:56.442878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:56.443140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:56.453050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:25:56.458304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:25:56.459435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:25:56.460616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 577/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:25:56.465243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:56.560672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99051057-7a9e-4cdc-81d2-653e1ab3cc60 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:56.574528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:56.594027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:56.594620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:56.594896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:56.595166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:56.595811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:56.596112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:56.597485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:56.605183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 580/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:56.611082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:56.707959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9947d69-c579-4cd6-9bc6-28a0396c7534 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:56.720936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:56.740816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:56.741423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:56.741700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:56.742004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] PATH_INFO: `/v3/users/98dea98d0bbb425c87dfedb01fb6331a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:56.743097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] RBAC: Authorizing `identity:get_user(user_id=98dea98d0bbb425c87dfedb01fb6331a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:56.744507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:56.746087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 578/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:25:56 2022] GET /identity/v3/users/98dea98d0bbb425c87dfedb01fb6331a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:56.751789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:56.847260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c21f-927c-44dc-b3fb-73d749d329a1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:56.879443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:56.880029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:56.880307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:56.880577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:56.922719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:56.945485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:56.946953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:57.040106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 581/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:25:57.046086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:57.140853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857dfc4-f55a-45ff-bbb1-f460b278e29a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:57.172743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:57.173345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:57.173621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:57.173920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] PATH_INFO: `/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:57.175569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] RBAC: Authorizing `identity:get_project(project_id=746a16a00e0f4e48ad6ac054aacf82ce)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:57.176971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae9a36-74e8-48f6-95e6-0f6fde87c26b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:57.178573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 579/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:25:57 2022] GET /identity/v3/projects/746a16a00e0f4e48ad6ac054aacf82ce => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:57.184538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:57.261064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:57.286459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59dbd-d275-454c-951e-0137cd8b0355 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:57.319495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:57.320089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:57.320365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:57.320634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:57.321342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=746a16a00e0f4e48ad6ac054aacf82ce, user.id=98dea98d0bbb425c87dfedb01fb6331a) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:25:57.321644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:57.323078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3d87b-a7a7-4f94-ac2b-70fc0fc1edf0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:25:57.328561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 582/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:25:57 2022] GET /identity/v3/role_assignments?user.id=98dea98d0bbb425c87dfedb01fb6331a&scope.project.id=746a16a00e0f4e48ad6ac054aacf82ce&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:25:59.448115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40189f-421b-4aa1-9d5c-b018d29bcab2 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:59.448753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40189f-421b-4aa1-9d5c-b018d29bcab2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:59.448753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40189f-421b-4aa1-9d5c-b018d29bcab2 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:59.449990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 580/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:25:59.455065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:59.455522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:59.455624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:59.473673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:25:59.474877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:25:59.538312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 583/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:25:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:25:59.799348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40189f-421b-4aa1-9d5c-b018d29bcab2 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:25:59.850168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:25:59.898110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40189f-421b-4aa1-9d5c-b018d29bcab2 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:25:59.929891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:25:59.930467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:25:59.930740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:25:59.931007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:25:59.994130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:25:59.995546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:00.041424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:00.090207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 581/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:25:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:26:00.096001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:00.160955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:00.191282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ace0df-f490-4f87-b7c9-6a39a3d68b0a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:00.223103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:00.223710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:00.223984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:00.224249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:00.230632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:00.232033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-42619fee-085a-4444-965b-a4b1a18d86d8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:26:00.242867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:26:00.244121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:26:00.245245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 584/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:26:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:26:00.249663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:00.344022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f2d73-337c-48db-9e58-c267f7ed9be5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:00.376006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:00.376596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:00.376878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:00.377148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:00.378367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:00.378687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:00.380043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d157ea-fa43-494e-8165-9c284d22eb89 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:00.387012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 582/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 15:26:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:02.492993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201233c8-e93a-4985-ab28-d5992c993553 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:02.493569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201233c8-e93a-4985-ab28-d5992c993553 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:02.493569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201233c8-e93a-4985-ab28-d5992c993553 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:02.494885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 585/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:02.499988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf287d2-531a-4006-89df-6213a57cee22 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:02.500427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf287d2-531a-4006-89df-6213a57cee22 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:02.500535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf287d2-531a-4006-89df-6213a57cee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:02.519313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6cf287d2-531a-4006-89df-6213a57cee22 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:02.520491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6cf287d2-531a-4006-89df-6213a57cee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:02.529718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:02.590939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 583/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:02.856243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201233c8-e93a-4985-ab28-d5992c993553 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:02.954626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201233c8-e93a-4985-ab28-d5992c993553 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:02.987544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:02.994077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:02.994678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:02.994953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:02.995426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:02.995894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:02.997244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4840954-9425-4a30-a7b5-608e0be20c7b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:03.013345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 586/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Sep 12 15:26:02 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:26:05.184173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6df3-7eaf-4cb2-89e1-37e75c958534 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:05.184726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6df3-7eaf-4cb2-89e1-37e75c958534 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:05.184726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6df3-7eaf-4cb2-89e1-37e75c958534 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:05.186206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 584/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:05.192002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:05.192419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:05.192563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:05.210847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:05.212029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:05.276655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 587/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:05.545855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6df3-7eaf-4cb2-89e1-37e75c958534 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:05.643165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6df3-7eaf-4cb2-89e1-37e75c958534 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:05.675596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:05.676199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:05.676476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:05.676749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] PATH_INFO: `/v3/domains/37639d21b3ff48638ae3db212ab7c132` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:05.686897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=37639d21b3ff48638ae3db212ab7c132)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:05.688339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87cce6-2538-453b-a669-a4f4e7b9f5e2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:05.689952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 585/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 12 15:26:05 2022] GET /identity/v3/domains/37639d21b3ff48638ae3db212ab7c132 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:05.696229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:05.790928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb2fee-3077-4f98-85d2-c6a88aa583e6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:05.810292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:05.825025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:05.825618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:05.825936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:05.826209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:05.826857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:05.828287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea404c1-e807-4f66-8d45-556c7a73bd78 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:05.854344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 588/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:26:05 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:26:07.982966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1ab-24f8-49bf-a108-c63fbe068642 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:07.983499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1ab-24f8-49bf-a108-c63fbe068642 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:07.983499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1ab-24f8-49bf-a108-c63fbe068642 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:07.984828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 586/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:07.990599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:07.991035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:07.991134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:08.009574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:08.010786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:08.074232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 589/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:08.338655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f1ab-24f8-49bf-a108-c63fbe068642 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:08.342375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:08.438891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f1ab-24f8-49bf-a108-c63fbe068642 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:08.470653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:08.471257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:08.472047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:08.472317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] PATH_INFO: `/v3/domains/37639d21b3ff48638ae3db212ab7c132` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:08.473414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=37639d21b3ff48638ae3db212ab7c132)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:08.474862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd465fa3-38e2-416d-bdaf-909d71b339c2 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:08.476378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 587/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 12 15:26:08 2022] GET /identity/v3/domains/37639d21b3ff48638ae3db212ab7c132 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:08.482043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:08.574526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dec790-762d-4a24-91d9-00c366616e34 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:08.575993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:08.610420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:08.610951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:08.611225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:08.611492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:08.612173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:08.613585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dc8ad-b8b1-40b3-9f9b-b09475261f11 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:08.633751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 590/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:26:08 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:26:10.826865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161eb13-0ff0-40df-9a40-f4134a1f7bed None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:10.827436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161eb13-0ff0-40df-9a40-f4134a1f7bed None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:10.827436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161eb13-0ff0-40df-9a40-f4134a1f7bed None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:10.828726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 588/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:10.834448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:10.834844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:10.834992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:10.853288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:10.854487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:10.917613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 591/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:11.186524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161eb13-0ff0-40df-9a40-f4134a1f7bed None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:11.255548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:11.285682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161eb13-0ff0-40df-9a40-f4134a1f7bed None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:11.317835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:11.318442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:11.318721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:11.318992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:11.329126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:26:11.334403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:26:11.335575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:26:11.336732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 589/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:26:11.341394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:11.427195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:11.439769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5b1b9-cfe3-4f85-9299-b1f9764763cb None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:11.472785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:11.473383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:11.473664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:11.473964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:11.474622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:11.474927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:11.476290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:11.483997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 592/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:11.489943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:11.586972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69a529-1cdb-414e-a28a-5dfeaa25e229 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:11.614912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:11.620091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:11.620708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:11.620985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:11.621256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] PATH_INFO: `/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:11.634526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] RBAC: Authorizing `identity:get_user(user_id=331fdbf96c8440b6b9f66cd2255ae6f4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:11.635954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:11.637521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 590/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:26:11 2022] GET /identity/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:11.643312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:11.741189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74340ffe-070a-40b7-8331-fbf962112c05 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:11.772841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:11.773434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:11.773709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:11.774006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:11.791523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:11.838241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:11.839670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:11.932245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 593/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:26:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:26:11.938380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:12.032007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b106e8-5b78-4301-9913-c4982f4285d8 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:12.064556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:12.065187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:12.065462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:12.065758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] PATH_INFO: `/v3/projects/fdb543a412de45579b3f0172f9ac9605` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:12.066840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] RBAC: Authorizing `identity:get_project(project_id=fdb543a412de45579b3f0172f9ac9605)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:12.068250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79eceb-8ac5-4196-a04e-0368db708d0d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:12.069839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 591/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:26:11 2022] GET /identity/v3/projects/fdb543a412de45579b3f0172f9ac9605 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:12.075971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:12.123403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:12.170904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e62ac2-c06e-49c5-8c9b-d6383020606a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:12.203282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:12.203865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:12.204141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:12.204410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:12.205116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=fdb543a412de45579b3f0172f9ac9605, user.id=331fdbf96c8440b6b9f66cd2255ae6f4) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:12.205420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:12.206881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947a4a-3d1d-4598-ba29-302f1ab29fa0 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:12.212032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 594/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:26:12 2022] GET /identity/v3/role_assignments?user.id=331fdbf96c8440b6b9f66cd2255ae6f4&scope.project.id=fdb543a412de45579b3f0172f9ac9605&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:14.291579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105172c-e56c-4420-8fd8-913f8f97d710 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:14.292140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105172c-e56c-4420-8fd8-913f8f97d710 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:14.292140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105172c-e56c-4420-8fd8-913f8f97d710 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:14.293435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 592/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:14.298538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:14.298966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:14.299083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:14.317293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:14.318501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:14.385715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 595/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:14.650979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105172c-e56c-4420-8fd8-913f8f97d710 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:14.713299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:14.755225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105172c-e56c-4420-8fd8-913f8f97d710 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:14.788505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:14.789111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:14.789384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:14.789649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:14.799218 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:26:14.803886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:26:14.804993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:26:14.805884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 593/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:26:14.811050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:14.854479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:14.905914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a2c45-fe84-4776-879b-c66f31b8f4de None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:14.937980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:14.938561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:14.938835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:14.939099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:14.939740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:14.940559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:14.941927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:14.949538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 596/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:14.956452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:15.056817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d9ac-a22b-40af-a12d-bbd97e2999c9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:15.073855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:15.090862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:15.091472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:15.091746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:15.092014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] PATH_INFO: `/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:15.093121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] RBAC: Authorizing `identity:get_user(user_id=331fdbf96c8440b6b9f66cd2255ae6f4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:15.094565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:15.096107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 594/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:26:14 2022] GET /identity/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:15.101896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:15.195903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f9ef-df6e-40b4-9a86-99dfa91bbce5 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:15.202494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:15.229032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:15.229640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:15.229943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:15.230212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] PATH_INFO: `/v3/projects/fdb543a412de45579b3f0172f9ac9605` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:15.231306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdb543a412de45579b3f0172f9ac9605)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:15.232711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6bdb-00e0-42f3-9dda-b97439383bf5 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:15.234335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 597/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:26:15 2022] GET /identity/v3/projects/fdb543a412de45579b3f0172f9ac9605 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:15.240157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:15.335698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8e99-6d03-4378-8d27-15172638c20d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:15.368111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:15.368741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:15.369018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:15.369285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] PATH_INFO: `/v3/projects/fdb543a412de45579b3f0172f9ac9605/users/331fdbf96c8440b6b9f66cd2255ae6f4/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:15.371207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdb543a412de45579b3f0172f9ac9605, user_id=331fdbf96c8440b6b9f66cd2255ae6f4, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:15.372620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e466ae-013e-433a-bf22-e67fb4f67024 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:15.385353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 595/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:26:15 2022] PUT /identity/v3/projects/fdb543a412de45579b3f0172f9ac9605/users/331fdbf96c8440b6b9f66cd2255ae6f4/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:26:17.498639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0512c-01ea-4939-921b-7ffe43286a34 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:17.499171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0512c-01ea-4939-921b-7ffe43286a34 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:17.499171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0512c-01ea-4939-921b-7ffe43286a34 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:17.500518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 598/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:26:17.506331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:17.506710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:17.506877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:17.525112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:26:17.526578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:26:17.567386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:17.592946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 596/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:26:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:26:17.865280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0512c-01ea-4939-921b-7ffe43286a34 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:17.961971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0512c-01ea-4939-921b-7ffe43286a34 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:17.993180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:17.993818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:17.994091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:17.994358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.004369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:26:18.008986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:26:18.010081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:26:18.011013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 599/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:26:18.015971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:18.109621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe717-4c88-44bb-86a8-91ada980f4bd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:18.141759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:18.142289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:18.142562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:18.142833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.143560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:18.143857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:18.145204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:18.153068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 597/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:18.159515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:18.193268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:18.255559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dbf08-f6e0-4210-88c7-fa168cca2499 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:18.287952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:18.288551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:18.288825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:18.289092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] PATH_INFO: `/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.290199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] RBAC: Authorizing `identity:get_user(user_id=331fdbf96c8440b6b9f66cd2255ae6f4)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:18.291603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:18.293126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 600/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 15:26:18 2022] GET /identity/v3/users/331fdbf96c8440b6b9f66cd2255ae6f4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:18.298702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:18.337434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:18.398048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c72c-02fe-42c8-9530-e0991c8ba0dc None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:18.430662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:18.431247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:18.431521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:18.431785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.495593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:18.497037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:18.533869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:18.592966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 598/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:26:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:26:18.599103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:18.701051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5849e4-a49d-4d8f-84c8-277205c7519a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:18.703235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:18.739209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:18.739827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:18.740106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:18.740376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] PATH_INFO: `/v3/projects/fdb543a412de45579b3f0172f9ac9605` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.741476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] RBAC: Authorizing `identity:get_project(project_id=fdb543a412de45579b3f0172f9ac9605)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:18.742963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec8028-8f60-4c3f-8970-ee86627fa386 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:18.744592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 601/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 15:26:18 2022] GET /identity/v3/projects/fdb543a412de45579b3f0172f9ac9605 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:18.750740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:26:18.846073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd1358-a68d-4177-9cf4-0e5e92903ea3 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:26:18.878095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:26:18.878671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:26:18.878942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:26:18.879208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:26:18.879909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=fdb543a412de45579b3f0172f9ac9605, user.id=331fdbf96c8440b6b9f66cd2255ae6f4) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:26:18.880208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:26:18.881646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93231fc6-88ff-4913-9c9a-f107945a7c0e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:26:18.887108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 599/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:26:18 2022] GET /identity/v3/role_assignments?user.id=331fdbf96c8440b6b9f66cd2255ae6f4&scope.project.id=fdb543a412de45579b3f0172f9ac9605&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:26:28.735061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=15 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:26:28.884623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:14.279616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d929f-128a-45ec-a728-21c2d325ab63 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:14.280207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d929f-128a-45ec-a728-21c2d325ab63 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:14.280207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d929f-128a-45ec-a728-21c2d325ab63 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:14.282223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 602/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:14.289778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:14.289778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:14.289778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:14.308276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:14.309507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:14.405832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 600/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:14.669407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d929f-128a-45ec-a728-21c2d325ab63 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:14.802236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d929f-128a-45ec-a728-21c2d325ab63 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:14.849211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:14.850011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:14.850306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:14.850592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:14.862416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:14.864515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:14.880094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:14.881386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:14.882472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:14.882472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:14.882472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:14.882472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 603/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:14.887670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:15.026866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d460d5-0de3-45aa-8966-b5de961cff45 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:15.069148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:15.075764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:15.076736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:15.077119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:15.077521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:15.078392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:15.078829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:15.080431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2588686-bcbf-452b-a998-4295a7e9210c None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:15.097900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 601/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:15.101051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:15.163100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:15.225997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cbf72-95d4-411e-b3a9-b73763f022ff None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:15.268484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:15.269109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:15.269939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:15.270208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:15.270842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:15.272278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de317f8b-d494-41ad-bd58-955d2202e30f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:15.310196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 604/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 15:27:15 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:27:17.588732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d692e-ba99-4c7e-bfd2-52abdbdf2e07 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:17.589304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d692e-ba99-4c7e-bfd2-52abdbdf2e07 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:17.589304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d692e-ba99-4c7e-bfd2-52abdbdf2e07 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:17.590868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 602/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:17.596438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:17.596881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:17.596989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:17.616300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:17.617485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:17.693643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 605/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:18.018138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d692e-ba99-4c7e-bfd2-52abdbdf2e07 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:18.148734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d692e-ba99-4c7e-bfd2-52abdbdf2e07 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:18.195339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:18.195947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:18.196356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:18.196637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:18.209633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:18.214589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:18.215623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:18.218819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 603/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:27:18.222340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:18.276955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:18.357232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94899-3695-419e-ad1c-c589864d0dba None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:18.397455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:18.398107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:18.398389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:18.398670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:18.399335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:18.399667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:18.401413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:18.417063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 606/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:18.425321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:18.483036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:18.545340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b4d-6473-446a-a698-757cbc6ea798 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:18.585364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:18.586383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:18.586878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:18.587299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:18.607065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:18.608942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:18.631751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:18.634321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:18.635243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:18.635243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:18.635243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:18.635243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 604/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:18.641513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:18.777123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:18.780386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee546ca-06d3-44b3-aa87-3382ba641b62 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:18.818196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:18.818728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:18.819007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:18.819276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:18.819917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:18.820209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:18.821570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:18.833986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 607/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:18.840938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:18.961648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7f0b7-2a75-4b2a-95d7-366207b1fcea None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:18.963533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:19.002970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:19.004245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:19.004593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:19.004928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:19.012896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:19.014543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:19.026965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:19.028515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:19.029708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:19.035586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 605/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:19.037743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:19.150649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def489d-6190-4db8-85ea-53fffe3fee60 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:19.190058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:19.190684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:19.191016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:19.191345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:19.192163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:19.192421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:19.193993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:19.213533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 608/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:19.219749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:19.331034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee45eb-6746-4428-9f73-a8ca4fbcb909 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:19.368674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:19.369277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:19.369611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:19.369916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:19.413586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:19.458470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:19.460216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:19.583599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 606/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:27:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:27:19.584544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:19.610251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:19.705788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3097229-8540-4753-bb7f-405a836d4bcb None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:19.746023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:19.746818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:19.747190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:19.747575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:19.758682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:19.760156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:19.776205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:19.777675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:19.778899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:19.778899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:19.778899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:19.784460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 609/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:27:19.786392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:19.854049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:19.904944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f42eaf-5997-4833-b8ca-7f2af75b2027 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:19.942636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:19.943373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:19.943715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:19.944053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:19.944767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:19.945140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:19.946607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:19.959884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 607/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:27:19.965817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:20.045516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:20.087671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbe24f-9ffb-41e2-ac56-1fb41fc6eb4b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:20.131453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:20.132202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:20.132539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:20.132813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:20.140131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:20.141589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:20.154668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:20.155918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:20.156939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 610/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:20.162299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:20.278967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d696-903a-48bd-9d16-13120d089722 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:20.317279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:20.337442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:20.338217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:20.338595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:20.338963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:20.339823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:20.340158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:20.341759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864cf7af-432b-4d13-98ce-2f459bea1599 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:20.355174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 608/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:27:20.361588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:20.491675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7322-499e-42fd-a90e-f2abac793381 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:20.527168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:20.534456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:20.535079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:20.535430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:20.535638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:20.536372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=124f41a738ee4b998ecddc566b09d78c) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:20.536707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:20.538187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2976-f5aa-4be2-998c-9c6ccc486e35 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:20.544169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 611/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:27:20 2022] GET /identity/v3/role_assignments?user.id=124f41a738ee4b998ecddc566b09d78c&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:22.809154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e654e-d1f5-415d-97a0-903d23717e77 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:22.809762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e654e-d1f5-415d-97a0-903d23717e77 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:22.809762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e654e-d1f5-415d-97a0-903d23717e77 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:22.811157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 609/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:22.816825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:22.817309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:22.817411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:22.837585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:22.838837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:22.911347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 612/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 15:27:23.197421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e654e-d1f5-415d-97a0-903d23717e77 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:23.307741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e654e-d1f5-415d-97a0-903d23717e77 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:23.346895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:23.347543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:23.347822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:23.348093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:23.358265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:23.362956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:23.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:23.364944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 610/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:27:23.370195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:23.480411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c646-8a5a-4810-80c9-d21a0bd8e82d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:23.504425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:23.517184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:23.517846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:23.518139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:23.518456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:23.519727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] RBAC: Adding query filter params (name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:23.520018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:23.521404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:23.530322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 613/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:23.536777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:23.586920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:23.646603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb6958-7ae0-4b98-9546-def74e064e7e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:23.690275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:23.691033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:23.691324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:23.691583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:23.704635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:23.706198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:23.723156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:23.724339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:23.725470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:23.725470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:23.725470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:23.725470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 611/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:23.730321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:23.835149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50c17d-f91e-446f-abc4-91d3231ed68f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:23.870772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:23.871446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:23.871804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:23.872086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:23.872807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:23.873227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:23.874718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:23.888698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 614/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:23.894648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:23.998636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:24.006157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec32fb6-1f1d-4276-a79c-f50e98a2799e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.044111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.044896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.045275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.045650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.054107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.055853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:24.067026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:24.068308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:24.069532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 612/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:24.074247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:24.129941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:24.186762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173d4d3-1f00-4080-9169-0ae4bb470cf4 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.224585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.225325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.225749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.226034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.226948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:24.227232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.228907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.249274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 615/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:24.255673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:24.366736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89130b-7fb6-458f-b83d-55e1fa28253d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.409223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.410075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.410521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.410797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.425171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.427676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:24.445182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:24.446527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:24.447712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:24.447712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:24.447712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:24.447712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 613/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:24.452617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:24.566542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c01eb0-961a-402f-a9b9-d6d140f949e7 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.569137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:24.603926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.604527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.604808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.605073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.605706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:24.606050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.607400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.620533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 616/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:24.626191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:24.637091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:24.744982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7881f-b833-4446-ad52-b90951c00c66 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.783914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.784752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.785101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.785498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.793507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.795269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:24.808970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:24.810099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:24.811277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:24.815262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 614/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:24.816778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:24.919281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a02cf-ec43-4f47-8f66-2f982c1a7b03 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:24.957117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:24.957675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:24.957979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:24.958246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:24.958924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:24.959221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:24.960661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07d48-ae28-4b34-83c1-5a16445fe4fa None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:24.972617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 617/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:24.978945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:25.051993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:25.091529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361375a-04a8-4ba6-be4a-c4831717eb41 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:25.132100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:25.132774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:25.133047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:25.133318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/124f41a738ee4b998ecddc566b09d78c/roles/da58c40552e342a2bf742a5c93d4d86c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:25.150566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=124f41a738ee4b998ecddc566b09d78c, role_id=da58c40552e342a2bf742a5c93d4d86c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:25.152050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063d407-e7c4-4374-ab6d-220fe75fde4b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:25.165928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 615/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:27:24 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/124f41a738ee4b998ecddc566b09d78c/roles/da58c40552e342a2bf742a5c93d4d86c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:27:27.545010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c90-6c32-425d-86b5-01464cfadd96 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:27.545545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c90-6c32-425d-86b5-01464cfadd96 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:27.545545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c90-6c32-425d-86b5-01464cfadd96 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:27.546938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 618/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:27.553313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:27.553800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:27.554054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:27.572741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:27.574263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:27.653561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 616/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:27.919574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402c90-6c32-425d-86b5-01464cfadd96 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:27.947909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:28.030381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402c90-6c32-425d-86b5-01464cfadd96 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.067684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.068575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.068933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.069300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.080459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:28.085843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:28.086950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:28.088139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 619/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 15:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:28.093891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:28.142297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:28.201509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d925e3-7e6f-4855-ad32-36c05304471c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.239837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.240537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.240823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.241094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.241863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] RBAC: Adding query filter params (name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:28.242238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:28.243858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:28.252392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 617/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 15:27:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:28.259388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:28.346309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:28.362399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d389-8e7e-456e-b66a-99a70615794a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.399815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.400524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.400791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.401093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.415922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:28.417601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:28.434389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:28.435770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:28.436685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:28.436685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:28.436685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:28.436685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 620/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:27:28.445327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:28.563890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cdf05-ef3d-4048-ba3a-49b873eb75db None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.574062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:28.602799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.603574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.603905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.604282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.605114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:28.605595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:28.607376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:28.621600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 618/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:28.627425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:28.746571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d3fa-4eef-436e-bae7-f199219c9e5f None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.785082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.785817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.786125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.786423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.789499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:28.796063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:28.798010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:28.811141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:28.812350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:28.813442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 621/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:28.819261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:28.932953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e47f-4972-4d9d-9789-19d3a48dfd27 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:28.972471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:28.973172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:28.973573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:28.973992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:28.974833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:28.975138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:28.976925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:28.998147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 619/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:29.006028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:29.135158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce7d0-2238-4917-8c4a-e7ac7b15061b None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:29.188740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:29.189462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:29.189689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:29.190042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:29.256764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:29.264540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:29.266775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:29.376872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 622/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:27:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:27:29.384588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:29.422789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:29.504000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636ff42-b551-423f-b522-30db47ccf359 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:29.540618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:29.541328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:29.541677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:29.542061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:29.553140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:29.554661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:29.572975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:29.575322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:29.577034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:29.577034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:29.577034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:29.577034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 620/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:29.580923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:29.682801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:29.689863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c6541-4709-4a5b-b35e-19cda765640e None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:29.730852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:29.731698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:29.732018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:29.732437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:29.733079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:29.733381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:29.734776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:29.748691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 623/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:29.754738 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:29.849087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:29.874416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b4f3d-fdb3-4cce-b641-1222c7112cfd None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:29.912489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:29.913112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:29.913391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:29.913664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:29.923539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:29.924999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:29.936551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:29.937640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:29.938899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 621/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 15:27:29.944269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:30.055871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1bbe3-58b8-4988-a854-f12dfd642f3d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:30.094451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:30.095069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:30.095375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:30.095722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:30.096433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:30.096739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:30.098684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a9f15-891d-4085-b7be-bfb2e5ebfc24 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:30.111272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 624/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:30.118822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:30.239426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bee1fe-31af-47bc-ba8c-b2bc72ace14b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:30.280467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:30.281248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:30.281526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:30.281824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:30.282604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] RBAC: Adding query filter params (role.id=da58c40552e342a2bf742a5c93d4d86c, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=124f41a738ee4b998ecddc566b09d78c) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:30.282912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:30.284373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f815f-34cf-41c9-ae60-30298a0570a9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:30.290621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 622/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:27:30 2022] GET /identity/v3/role_assignments?user.id=124f41a738ee4b998ecddc566b09d78c&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=da58c40552e342a2bf742a5c93d4d86c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:32.784396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8619-07e3-44f8-91fa-8097900fec2e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:32.785585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8619-07e3-44f8-91fa-8097900fec2e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:32.785683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd8619-07e3-44f8-91fa-8097900fec2e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:32.787581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 625/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:32.794105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:32.794105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:32.794105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:32.800118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:32.812882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:32.814114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:32.883255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 623/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:33.193030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8619-07e3-44f8-91fa-8097900fec2e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:33.212942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:33.306961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd8619-07e3-44f8-91fa-8097900fec2e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:33.348750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:33.349485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:33.349766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:33.350138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:33.360265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:33.365687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:33.366772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:33.367708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 626/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:33.373081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:33.495401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a23a24-a402-4336-83be-e7d3be8c096f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:33.529753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:33.535780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:33.536613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:33.536911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:33.537217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:33.538107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:33.538467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:33.540070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:33.548837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 624/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:33.556196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:33.642703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:33.667686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4190820-a913-495e-a41d-9af90358f512 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:33.708299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:33.709007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:33.709288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:33.709638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:33.724123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:33.725667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:33.743621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:33.744858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:33.746014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:33.746014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:33.746014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:33.746014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 627/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:33.751409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:33.877603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558d3d4-f44f-4fab-8f99-ef753a837525 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:33.913683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:33.914323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:33.914599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:33.914865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:33.915510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:33.915806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:33.917193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:33.930890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 625/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:33.936884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:34.045104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18216c2-aebc-4098-b8d5-6b14359d3b4a None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:34.072794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:34.081299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:34.082590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:34.083073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:34.083341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:34.092931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:34.094649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:34.108078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:34.114464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:34.115668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 628/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:34.116368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:34.173504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:34.219070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c057a71-6d1b-4913-977a-8a1e96cbab08 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:34.255288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:34.255904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:34.256181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:34.256450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:34.257180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:34.257486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:34.258963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:34.279227 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 626/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:34.285890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:34.390209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b38d-fc09-4e7e-8d42-03f3438042d8 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:34.430294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:34.430946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:34.431295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:34.431607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:34.495384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:34.510668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:34.512127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:34.609865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 629/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:27:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:27:34.615651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:34.712823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b9d4-74b6-4e27-afaf-964ea7d5f66d None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:34.725350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:34.746270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:34.746897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:34.747169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:34.747432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:34.758597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:34.760028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:34.774250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:34.775373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:34.776259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:34.776259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:34.776259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:34.776259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 627/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:34.781325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:34.865789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:34.878046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c657e-cd54-4dc5-a338-852dc304edcc None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:34.911159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:34.911767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:34.912040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:34.912310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:34.912933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:34.913231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:34.914595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:34.925653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 630/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:34.931116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:35.032771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea33ad9-6a46-4dca-b4bf-8c6d15f83592 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:35.066531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:35.067134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:35.067411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:35.067677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:35.074019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:35.075437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:35.086221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:35.087249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:35.088505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 628/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:35.093087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:35.187979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b966f8-ddda-4f18-8dd0-ef05619ec399 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:35.220375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:35.220962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:35.221240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:35.221509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:35.222245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:35.222548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:35.223948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bc3dd-2dbf-4588-80cc-777984666c0d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:35.235301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 631/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:35.241288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:35.266195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:35.339616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251ccc9-f164-4efc-9ab7-a14f07b69fd9 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:35.370676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00271537-29f1-42e8-b430-93735a67994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:35.371256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271537-29f1-42e8-b430-93735a67994f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:35.371530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271537-29f1-42e8-b430-93735a67994f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:35.371796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00271537-29f1-42e8-b430-93735a67994f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:35.372500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00271537-29f1-42e8-b430-93735a67994f None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=124f41a738ee4b998ecddc566b09d78c) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:35.372801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00271537-29f1-42e8-b430-93735a67994f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:35.374233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00271537-29f1-42e8-b430-93735a67994f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:35.381223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 629/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:27:35 2022] GET /identity/v3/role_assignments?user.id=124f41a738ee4b998ecddc566b09d78c&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:37.509038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592e18a-3c32-4bb9-85d7-6b1a35be0b93 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:37.509580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592e18a-3c32-4bb9-85d7-6b1a35be0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:37.509580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592e18a-3c32-4bb9-85d7-6b1a35be0b93 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:37.510930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 632/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:37.516164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:37.516605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:37.516697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:37.535389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:37.536547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:37.599229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 630/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:37.868447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592e18a-3c32-4bb9-85d7-6b1a35be0b93 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:37.879097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:37.965587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592e18a-3c32-4bb9-85d7-6b1a35be0b93 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:37.998118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:37.998718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:37.998994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:37.999259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.008783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:38.013408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:38.014533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:38.015363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 633/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:38.020957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.039387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:38.117063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9d38-62fd-4464-b4e6-934733c21f0b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.150263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.150797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.151073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.151340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.151990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:38.152289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.153923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.161698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 631/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:38.167320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.233144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:38.264901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadeec6-100d-4ea5-a9f8-5e5c08adcf11 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.296619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.297217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.297491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.297777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.307687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.309076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:38.322915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:38.323986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:38.325082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:38.325082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:38.325082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:38.325082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 634/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:38.329663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.418124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:38.439727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69cbb0-3c6e-448b-9178-aad39a3083a4 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.476238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.476833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.477107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.477375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.478165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:38.478468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.479831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.491569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 632/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:38.497238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.591539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be227676-9e1b-4aff-8730-9bfdfc394a77 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.609958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:38.623894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.624494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.624767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.625032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.633065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.634512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:38.645102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:38.646216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:38.647164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 635/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:38.651867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.747606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc9df-fe13-4ec6-8611-dd45f29bb84b None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.780194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.780780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.781052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.781317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.782047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:38.782346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.783744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.791918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:38.800639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 633/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:38.806527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:38.900958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5ebd-2c98-4e49-a336-da7b8eb2e500 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:38.933150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:38.933759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:38.934037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:38.934303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:38.944683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:38.946081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:38.959782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:38.960902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:38.962050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:38.962050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:38.962050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:38.962050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 636/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:38.966565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:39.063089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598565bb-7d7d-4dec-a747-178c01f45f39 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:39.095638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:39.096219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:39.096497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:39.096768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:39.097940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:39.098242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:39.099588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:39.110347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 634/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:39.116331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:39.145974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:39.212963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2d321-bf20-493d-9ce3-f396f25f255d None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:39.245095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:39.245698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:39.246001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:39.246264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:39.252533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:39.254004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:39.265241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:39.266352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:39.267671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 637/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:39.272672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:39.328021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:39.368847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834844f0-3665-44d1-9891-809851cffd7f None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:39.405452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:39.406228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:39.406509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:39.406788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:39.407677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:39.407986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:39.410134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650049-1b41-4935-8206-6cfe8ef35251 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:39.421675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 635/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:27:39.427634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:39.513622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:39.523189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e845a2-b69c-48ae-8a92-116aa58176b6 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:39.555142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:39.555764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:39.556037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:39.556304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] PATH_INFO: `/v3/projects/012215e5533343f79ff567e18eb4251d/users/124f41a738ee4b998ecddc566b09d78c/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:39.558174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] RBAC: Authorizing `identity:create_grant(project_id=012215e5533343f79ff567e18eb4251d, user_id=124f41a738ee4b998ecddc566b09d78c, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:39.559583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39d1ca-21a7-49f8-b4ab-9dbe943316ab None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:39.571476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 638/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 15:27:39 2022] PUT /identity/v3/projects/012215e5533343f79ff567e18eb4251d/users/124f41a738ee4b998ecddc566b09d78c/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:27:41.745596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023e6c-55c1-4ee7-aa83-fb0d7149b01a None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:41.746237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023e6c-55c1-4ee7-aa83-fb0d7149b01a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:41.746237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f023e6c-55c1-4ee7-aa83-fb0d7149b01a None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:41.747484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 636/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:41.752729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:41.753219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:41.753409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:41.774246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:41.775608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:41.839282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 639/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:42.101355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f023e6c-55c1-4ee7-aa83-fb0d7149b01a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.198101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f023e6c-55c1-4ee7-aa83-fb0d7149b01a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:42.215785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:42.232092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:42.232694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:42.232965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:42.233229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:42.243286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 15:27:42.248855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:42.250085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:42.251208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 637/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:42.256391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.337828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:42.357053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3ed75-ca50-49d5-8d82-9b2ffe065fc2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:42.396922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:42.397717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:42.398266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:42.398574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:42.399439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:42.399921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:42.401692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:42.412551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 640/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:42.419179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.523414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0ae4a-6f98-4b75-a437-b13d0f30b4ed None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:42.555267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:42.555870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:42.556143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:42.556412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:42.566750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:42.568166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:42.581518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:42.582581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:42.583604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:42.583604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:42.583604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:42.583604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 638/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:42.588550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.685751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12f57b-5f32-4e31-9611-e1b875d6e852 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:42.717979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:42.718576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:42.718858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:42.719133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:42.719767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:42.720076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:42.721422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:42.733253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 641/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:42.739467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.772375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:42.840462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60c0b-5aca-4875-b84e-803a2a1bbaac None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:42.872868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:42.873466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:42.873763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:42.874041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:42.883340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:42.884850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 15:27:42.895898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:42.897053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:42.898422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 639/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:42.903094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:42.907781 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.000222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad50-1f17-4168-a21d-c5ba1e0d345c None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.032302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.032885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.033160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.033427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.034162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:43.035001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.036397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.053060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 642/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 15:27:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:43.058787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:43.145214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.155324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7468-ba62-4e93-a35a-d6f789c12a5e None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.191172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.191786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.192045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.192308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.257525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.258909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.343537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.354433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 640/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 15:27:43.360387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:43.424396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.461956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd267d2b-ae91-4b98-8ff1-da7084a10404 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.494410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.495024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.495300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.495567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.505639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.507084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 15:27:43.521956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:43.523073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 15:27:43.524202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 15:27:43.524202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 15:27:43.524202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:43.524202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 643/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:43.528893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:43.626632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20f715-ee80-4753-b624-497f6f92532a None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.659904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.660489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.660790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.661058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.661683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:43.662010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.663352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.674025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 641/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:43.679507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:43.775307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a48b-a659-4a6c-80b7-302c28c9c303 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.788633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.808661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.809269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.809541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.809835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.816619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.818062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 15:27:43.828716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:43.829789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: ERROR keystone.server.flask.application Sep 12 15:27:43.830936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 644/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:43.835828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:43.884363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:43.932374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe10e-d498-487b-8e44-213a8c4f8080 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:43.964303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:43.964885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:43.965161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:43.965436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:43.966141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:43.966442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:43.967839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281194b-2a47-45ba-b29d-537a18513866 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:43.979220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 642/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:27:43.985142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:44.079762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adea6b-4dfc-431a-9a8f-c82f7e059f83 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:44.111674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:44.112246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:44.112546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:44.112813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:44.113509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] RBAC: Adding query filter params (role.id=4d009788d3b744b6974d4cd0673a0a5b, scope.project.id=012215e5533343f79ff567e18eb4251d, user.id=124f41a738ee4b998ecddc566b09d78c) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:44.113836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:44.115226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cb806-63a8-4bf2-8c16-4171c820f66e None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:44.120647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 645/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 15:27:43 2022] GET /identity/v3/role_assignments?user.id=124f41a738ee4b998ecddc566b09d78c&scope.project.id=012215e5533343f79ff567e18eb4251d&role.id=4d009788d3b744b6974d4cd0673a0a5b => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:46.254638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dba71-2b6c-4a77-8920-afaa7f0d059f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:46.255202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dba71-2b6c-4a77-8920-afaa7f0d059f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:46.255202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dba71-2b6c-4a77-8920-afaa7f0d059f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:46.256498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 643/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:46.261662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:46.262116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:46.262239 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:46.280225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:46.281385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:46.309698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:46.345667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 646/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:46.648439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dba71-2b6c-4a77-8920-afaa7f0d059f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:46.747233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dba71-2b6c-4a77-8920-afaa7f0d059f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:46.757447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:46.780728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:46.781339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:46.781616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:46.781913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] PATH_INFO: `/v3/services/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:46.782484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:46.783836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:46.792850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:46.794198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:46.795362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 644/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:27:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:46.799946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:46.894305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289781a-6bdc-4e3f-a391-fea68e4148db None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:46.927586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:46.928107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:46.928381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:46.928644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:46.929260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:46.929556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:46.930915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963b4bf-7b70-45fb-ba1c-32bc246e657d None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:46.935454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 647/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 15:27:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:46.940978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:47.038020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5475d-38b4-4c8d-a7c3-911e26ac0dce None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:47.069572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:47.070187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:47.070465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:47.070735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] PATH_INFO: `/v3/services` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:47.071346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:47.071644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:47.072982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5932-ef4e-4c34-9ec1-8db1436f2b04 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:47.077237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 645/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 15:27:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:49.178899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171cc8b-6782-454d-aba2-b703f064fa08 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:49.179490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171cc8b-6782-454d-aba2-b703f064fa08 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:49.179490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171cc8b-6782-454d-aba2-b703f064fa08 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:49.180784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 648/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:49.186031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f91c-6558-4e0f-aa0a-54c40db951a2 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:49.186477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f91c-6558-4e0f-aa0a-54c40db951a2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:49.186578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f91c-6558-4e0f-aa0a-54c40db951a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:49.205659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0373f91c-6558-4e0f-aa0a-54c40db951a2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:49.206927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0373f91c-6558-4e0f-aa0a-54c40db951a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:49.235595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:49.273396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 646/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:49.541156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171cc8b-6782-454d-aba2-b703f064fa08 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:49.571406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:49.640302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171cc8b-6782-454d-aba2-b703f064fa08 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:49.672819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:49.673410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:49.673692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:49.674000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:49.674640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:49.676604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b1d3ef-f931-4cf4-82f8-dd5f59734bed None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:49.692022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 649/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 15:27:49 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:27:51.812045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d269-ba11-4234-8a5e-09b668318116 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:51.812571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d269-ba11-4234-8a5e-09b668318116 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:51.812571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183d269-ba11-4234-8a5e-09b668318116 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:51.813944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 647/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:51.819108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:51.819484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:51.819652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:51.837370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:51.838611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:51.908274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 650/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:52.175395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183d269-ba11-4234-8a5e-09b668318116 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:52.271718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183d269-ba11-4234-8a5e-09b668318116 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:52.305238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:52.305861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:52.306134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:52.306401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:52.306964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:52.308305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:52.316709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:52.317873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:52.318908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 648/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:27:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:52.323623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:52.342090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:52.432654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba33770-b1f1-4edf-bcd6-54bfd0886810 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:52.469272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:52.469892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:52.470168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:52.470433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:52.471043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:52.471339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:52.472725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:52.477603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 651/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 15:27:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:52.483657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:52.514356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:52.580890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e846c8-3e26-4513-b167-6935daaa0d34 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:52.613241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:52.613858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:52.614135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:52.614405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:52.615090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] RBAC: Adding query filter params (interface=public, service_id=232593f234f341c685b2711a571e80fd, region_id=RegionOne) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:52.615395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:52.616752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782a3f1-aedf-4011-b5ad-96e7315c30ad None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:52.621573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 649/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 15:27:52 2022] GET /identity/v3/endpoints?service_id=232593f234f341c685b2711a571e80fd&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:52.627198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:52.705358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:52.724252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265880c-6c04-4468-ae8c-8f2cd9dd0ca1 None admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:52.756847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:52.757438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:52.757718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:52.758020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:52.758617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:52.759970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30005c-3306-47a1-9d9d-9f71288b1896 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:52.766534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 652/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 15:27:52 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:27:54.898240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e84e-b1cb-4473-b6a7-cd870ce45dbc None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:54.898794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e84e-b1cb-4473-b6a7-cd870ce45dbc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:54.898794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e84e-b1cb-4473-b6a7-cd870ce45dbc None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:54.900095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 650/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:27:54.905541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:54.906010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:54.906120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:54.924487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:27:54.926344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:27:54.990381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 653/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:27:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 15:27:55.253060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e84e-b1cb-4473-b6a7-cd870ce45dbc None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:55.344849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:55.352578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e84e-b1cb-4473-b6a7-cd870ce45dbc None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:55.386211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:55.386835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:55.387236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:55.387538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:55.388723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:55.390684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 15:27:55.401834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 15:27:55.403352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application with Lock( Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self._enter() Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application return self.creator() Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application created_value = creator( Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: ERROR keystone.server.flask.application Sep 12 15:27:55.404240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 651/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 15:27:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 15:27:55.410738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:55.484394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:27:55.506999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d83d5-77f8-4446-9ee9-3a9a4c068817 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:55.539975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:55.540559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:55.540833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:55.541100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] PATH_INFO: `/v3/services` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:55.541712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:27:55.542051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:55.543391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca6539-be6b-40d9-810d-9397e39d3a57 None admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:55.548245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 654/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 15:27:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:27:55.553855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:27:55.652736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a9d66-8981-42e3-ad5b-d8886f4f17b5 None admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:27:55.685790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:27:55.686064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:27:55.686342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:27:55.686612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:27:55.687281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:27:55.688634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aece53f-332e-41a8-8fcf-61db9aabd6b8 None admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:27:55.709137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 652/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:27:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:28:05.545553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=30 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:28:05.704693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:28:59.714577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092ed9-ad04-44f2-98ca-de3048c521e9 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:28:59.715643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092ed9-ad04-44f2-98ca-de3048c521e9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:28:59.716220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092ed9-ad04-44f2-98ca-de3048c521e9 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:28:59.718632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 655/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:28:59.724139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b0c9-5c75-44f0-9295-13b2b661f36d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:28:59.724562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b0c9-5c75-44f0-9295-13b2b661f36d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:28:59.724774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8b0c9-5c75-44f0-9295-13b2b661f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:28:59.826037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4ee8b0c9-5c75-44f0-9295-13b2b661f36d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:28:59.827324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4ee8b0c9-5c75-44f0-9295-13b2b661f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:28:59.941774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 653/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:00.231599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:00.231879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:00.232431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:00.233877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 656/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 12 15:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:00.242713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493b4f-fe1d-4352-a746-defe0df5bb9f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:00.243010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493b4f-fe1d-4352-a746-defe0df5bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:00.243267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73493b4f-fe1d-4352-a746-defe0df5bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:00.329186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-73493b4f-fe1d-4352-a746-defe0df5bb9f None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:00.330487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-73493b4f-fe1d-4352-a746-defe0df5bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:00.353339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:00.413336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 654/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 12 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:00.422179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:00.424553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:00.541071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f0ef3-3e4c-417e-bf18-533339cb6e93 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:00.627854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:00.628374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:00.628649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:00.628915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:00.630526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:00.692683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:00.752748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:00.754220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ae666-3c71-40ba-8a71-677798bf61c0 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:00.773165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 657/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:03.218909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889e27-040b-4f96-a3da-9fe5a154b123 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:03.219433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889e27-040b-4f96-a3da-9fe5a154b123 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:03.219433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34889e27-040b-4f96-a3da-9fe5a154b123 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:03.220822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 655/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:03.225976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c41d5-8658-4141-b01b-80c6b4d9efce None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:03.226382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c41d5-8658-4141-b01b-80c6b4d9efce None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:03.226649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c41d5-8658-4141-b01b-80c6b4d9efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:03.313695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-925c41d5-8658-4141-b01b-80c6b4d9efce None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:03.315656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-925c41d5-8658-4141-b01b-80c6b4d9efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:03.411773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 658/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:03.708600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:03.709008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:03.709344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:03.710816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 656/1314] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 12 15:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:03.716913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebae47-3fdf-4561-bf92-df7d1bf978f7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:03.717197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebae47-3fdf-4561-bf92-df7d1bf978f7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:03.717468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebae47-3fdf-4561-bf92-df7d1bf978f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:03.729705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:03.795563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-48ebae47-3fdf-4561-bf92-df7d1bf978f7 None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:03.796779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-48ebae47-3fdf-4561-bf92-df7d1bf978f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:03.872117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 659/1315] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 12 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:03.881131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:03.882672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:03.989380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a209221-6ddc-43c8-836f-668c4f04c695 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:04.060004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:04.062392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:04.063208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:04.063675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:04.064157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:04.065786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:04.172668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:04.174151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208041-f592-4e78-9d8b-ca000e746c0c service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:04.192018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 657/1316] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:06.837755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:06.838290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:06.838413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:06.839658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 660/1317] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:06.844958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a1d2-ea15-4b87-92f6-691c25cd7554 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:06.845910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a1d2-ea15-4b87-92f6-691c25cd7554 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:06.846025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a1d2-ea15-4b87-92f6-691c25cd7554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:06.910231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-72c4a1d2-ea15-4b87-92f6-691c25cd7554 None None] MFA Rules not processed for user `8d04519bfc714ca88b554ce264398057`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:06.911411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-72c4a1d2-ea15-4b87-92f6-691c25cd7554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:06.962221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:07.009603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 658/1318] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:07.293002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:07.294582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:07.407037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb44bf0-8655-4d17-a63c-e9329649afcd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:07.409785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:07.478630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:07.479228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:07.479506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:07.479775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:07.481357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:07.591081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:07.592425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568a7fc-f33f-46c3-bc3f-a447e2a9eca0 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:07.609555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 661/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:10.310905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:10.311448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:10.311448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:10.312778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 659/1320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:10.318017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801def-4ae4-42d4-a63b-ba257a122b06 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:10.318450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801def-4ae4-42d4-a63b-ba257a122b06 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:10.318546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801def-4ae4-42d4-a63b-ba257a122b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:10.359263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:10.384644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c6801def-4ae4-42d4-a63b-ba257a122b06 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:10.385911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c6801def-4ae4-42d4-a63b-ba257a122b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:10.482730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 662/1321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:10.766807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:10.768383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:10.867606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970001-5685-4bc7-a680-ba72ea70a686 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:10.940692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:10.941219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:10.941496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:10.941799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:10.943401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:10.950723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:11.050605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:11.052033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060df889-c025-4cd7-9eae-b4b14db215b6 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:11.069812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 660/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:14.069815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:14.070416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:14.070416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:14.071836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 663/1323] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:14.076980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77f2f-8905-4bda-8630-5d407ffa7641 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:14.077440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77f2f-8905-4bda-8630-5d407ffa7641 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:14.077543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a77f2f-8905-4bda-8630-5d407ffa7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:14.148225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-66a77f2f-8905-4bda-8630-5d407ffa7641 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:14.149475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-66a77f2f-8905-4bda-8630-5d407ffa7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:14.210653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:14.253088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 661/1324] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:14.542117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:14.543645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:14.646610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d598cff-973d-4b73-8e93-21f08fb97388 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:14.660270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:14.723786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:14.724389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:14.724666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:14.724934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:14.726542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:14.838071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:14.839501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4767981-3252-4565-8c48-fb332c8c3849 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:14.858179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 664/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:17.058875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:17.059437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:17.059437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:17.060753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 662/1326] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:17.066503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6a43-d32e-4a82-8852-4fd0d09cf1a7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:17.066969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6a43-d32e-4a82-8852-4fd0d09cf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:17.067183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e6a43-d32e-4a82-8852-4fd0d09cf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:17.116260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:17.134264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-175e6a43-d32e-4a82-8852-4fd0d09cf1a7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:17.135467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-175e6a43-d32e-4a82-8852-4fd0d09cf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:17.236619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 665/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:17.520813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:17.522369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:17.622234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01fc90-dadf-422e-a351-1f0cb3566330 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:17.703455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:17.704054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:17.704330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:17.705120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:17.706731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:17.724204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:17.821114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:17.822514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37916d50-94e1-48cc-9306-56ecedec67e8 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:17.840844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 663/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:20.045151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:20.045662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:20.045662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:20.047029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 666/1329] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:20.052648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021451-c689-48e3-95f1-7433dd1df6b0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:20.053087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021451-c689-48e3-95f1-7433dd1df6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:20.053190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021451-c689-48e3-95f1-7433dd1df6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:20.119721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-fc021451-c689-48e3-95f1-7433dd1df6b0 None None] MFA Rules not processed for user `8d04519bfc714ca88b554ce264398057`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:20.120949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fc021451-c689-48e3-95f1-7433dd1df6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:20.185144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:20.215928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 664/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:20.494545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:20.496076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:20.603452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eedc27-5976-475e-a9c6-74f0dbff59e3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:20.624172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:20.678025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:20.678630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:20.678906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:20.679175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:20.683420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:20.795446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:20.796881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515505c3-3ad7-4a65-bb03-cc8806cb4e33 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:20.815077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 667/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:23.200878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:23.201374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:23.201474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:23.202813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 665/1332] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:23.208639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2830-fd29-459d-95d1-6a5d1718e2b6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:23.209099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2830-fd29-459d-95d1-6a5d1718e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:23.209583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d2830-fd29-459d-95d1-6a5d1718e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:23.272387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:23.275062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a78d2830-fd29-459d-95d1-6a5d1718e2b6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:23.276854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a78d2830-fd29-459d-95d1-6a5d1718e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:23.377312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 668/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:23.661374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:23.663017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:23.763759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfa58-6e25-42dc-9eb0-748b33fbd053 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:23.837784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:23.838382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:23.838677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:23.838945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:23.840519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:23.867213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:23.951928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:23.953279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90c1a-a564-44fa-8843-0b46eb705f31 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:23.971572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 666/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:26.141449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:26.142025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:26.142106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:26.143403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 669/1335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:26.148780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a669-a07e-4cff-90f8-ee4a6854edf3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:26.149181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a669-a07e-4cff-90f8-ee4a6854edf3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:26.149336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62a669-a07e-4cff-90f8-ee4a6854edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:26.214771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8a62a669-a07e-4cff-90f8-ee4a6854edf3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:26.215958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8a62a669-a07e-4cff-90f8-ee4a6854edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:26.288233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:26.310545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 667/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:26.598383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:26.599951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:26.701829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e470-566f-46d6-a50c-d623423416b9 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:26.729440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:26.774596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:26.775191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:26.775466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:26.775734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:26.777301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:26.884099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:26.885442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa9a45-565d-46cb-b423-726627154822 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:26.903236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 670/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:29.375665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:29.376681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:29.376681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:29.377989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 668/1338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:29:29.383058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233c02-ab3e-4d84-abef-950a0867967f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:29.383454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233c02-ab3e-4d84-abef-950a0867967f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:29.383611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d233c02-ab3e-4d84-abef-950a0867967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:29.451096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0d233c02-ab3e-4d84-abef-950a0867967f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:29.452319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0d233c02-ab3e-4d84-abef-950a0867967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:29.461378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:29.547791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 671/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:29.834712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:29.836257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:29.945286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfebb1-10d8-4f6d-944d-c13b5714adc2 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:30.016228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:30.016845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:30.017121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:30.017392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:30.018983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:30.056056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:30.127831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:30.129262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a20ab-e7f0-4f7e-8d9b-df883ff25647 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:30.148409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 669/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:34.230940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:34.231498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:34.231498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:34.232860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 672/1341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:34.238267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b78d-b3e8-4cb6-8b7d-c5e80c5ba0e4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:34.238680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b78d-b3e8-4cb6-8b7d-c5e80c5ba0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:34.238818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8b78d-b3e8-4cb6-8b7d-c5e80c5ba0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:34.304460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-12a8b78d-b3e8-4cb6-8b7d-c5e80c5ba0e4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:34.305567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-12a8b78d-b3e8-4cb6-8b7d-c5e80c5ba0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:34.390757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:34.419684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 670/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:34.701687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:34.703232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:34.807416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804ae9-2028-445d-a039-aebcd8f85375 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:34.845748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:34.882217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:34.882818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:34.883098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:34.883359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:34.884914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:34.994936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:34.996358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdd79a-0600-4da1-9365-7d5bca29bbff service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:35.015048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 673/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:37.781694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:37.782277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:37.782437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:37.783927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 671/1344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:29:37.790631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efab9a0-e506-449b-a14c-51b774756302 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:37.791049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efab9a0-e506-449b-a14c-51b774756302 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:37.791274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efab9a0-e506-449b-a14c-51b774756302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:37.868157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0efab9a0-e506-449b-a14c-51b774756302 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:37.869475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0efab9a0-e506-449b-a14c-51b774756302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:37.888265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:37.966707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 674/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:38.249288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:38.250843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:38.357840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c76a0b-417e-48dd-af94-04cfceaef6ed None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:38.443325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:38.443926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:38.444204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:38.444477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:38.446097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:38.489528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:38.560633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:38.562024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e775e-4f9b-4862-b5ce-ecaada8aad38 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:38.581593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 672/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:42.794318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:42.794846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:42.794846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:42.796202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 675/1347] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:42.802057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6be2-006f-493a-89e4-1294dce14a3d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:42.802452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6be2-006f-493a-89e4-1294dce14a3d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:42.802609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6be2-006f-493a-89e4-1294dce14a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:42.871847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f2bd6be2-006f-493a-89e4-1294dce14a3d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:42.873048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f2bd6be2-006f-493a-89e4-1294dce14a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:42.971076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:42.974136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 673/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:43.258125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:43.259785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:43.361772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1b1f1-7e0a-45f4-870b-b64e2071dd5f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:43.409785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:43.434869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:43.435460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:43.435733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:43.435999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:43.437562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:43.543992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:43.545408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cbe97-58b6-44ef-b61f-4fca51a55405 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:43.563313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 676/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:29:48.455284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb509f-4361-47c8-8d95-2d6c0d33a5e8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:48.455832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb509f-4361-47c8-8d95-2d6c0d33a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:48.455832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb509f-4361-47c8-8d95-2d6c0d33a5e8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:48.457341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 674/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:48.462927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea7a1-ca0e-4b89-9dd3-988ff698ff4f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:48.463377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea7a1-ca0e-4b89-9dd3-988ff698ff4f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:48.463471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea7a1-ca0e-4b89-9dd3-988ff698ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:48.575482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-027ea7a1-ca0e-4b89-9dd3-988ff698ff4f None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:48.578161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-027ea7a1-ca0e-4b89-9dd3-988ff698ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:48.598817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:48.720967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 677/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:29:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:29:52.990379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b517-46ed-4658-b697-2fe0106daa21 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:52.990898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b517-46ed-4658-b697-2fe0106daa21 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:52.990898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9b517-46ed-4658-b697-2fe0106daa21 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:52.992417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 675/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:52.997587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037f0f-2cfc-4814-92c4-6b4b14043851 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:52.998127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037f0f-2cfc-4814-92c4-6b4b14043851 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:52.998370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3037f0f-2cfc-4814-92c4-6b4b14043851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:53.085173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a3037f0f-2cfc-4814-92c4-6b4b14043851 None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:53.086756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a3037f0f-2cfc-4814-92c4-6b4b14043851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:53.170094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:53.208865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 678/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:54.410593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ee07-bbc0-45c7-bb9f-a466af57f8a8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:54.411238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ee07-bbc0-45c7-bb9f-a466af57f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:54.411238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ee07-bbc0-45c7-bb9f-a466af57f8a8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:54.412503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 676/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:54.417576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f398-3a59-4ea9-af9b-ce83fe66b4ac None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:54.418001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f398-3a59-4ea9-af9b-ce83fe66b4ac None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:54.418156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0f398-3a59-4ea9-af9b-ce83fe66b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:54.496037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-14d0f398-3a59-4ea9-af9b-ce83fe66b4ac None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:54.497241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-14d0f398-3a59-4ea9-af9b-ce83fe66b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:54.604364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 679/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:29:58.222228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89929cd-a81c-43df-9dae-7b0280e8c981 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:58.222755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89929cd-a81c-43df-9dae-7b0280e8c981 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:58.222755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89929cd-a81c-43df-9dae-7b0280e8c981 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:58.224216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 677/1356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:58.229325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6f5f-4677-49f5-b8a9-3fe18a6f8784 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:58.229833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6f5f-4677-49f5-b8a9-3fe18a6f8784 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:58.229833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd6f5f-4677-49f5-b8a9-3fe18a6f8784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:58.267337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:58.303331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a5bd6f5f-4677-49f5-b8a9-3fe18a6f8784 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:58.304528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a5bd6f5f-4677-49f5-b8a9-3fe18a6f8784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:58.409750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 680/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:58.710323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:58.710609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:58.710884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:58.712215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 678/1358] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:29:58.721651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50108-06ec-473b-aeda-60bdbba29112 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:58.722222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50108-06ec-473b-aeda-60bdbba29112 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:58.723011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50108-06ec-473b-aeda-60bdbba29112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:58.827483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4ae50108-06ec-473b-aeda-60bdbba29112 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:29:58.829406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4ae50108-06ec-473b-aeda-60bdbba29112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:58.879992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:58.958435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 681/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:29:58.966417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:29:58.967955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:59.121043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614add0-8eeb-4bc7-826a-074dc2b975b8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:29:59.195588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:29:59.236791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:29:59.237400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:29:59.237656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:29:59.237956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:29:59.239557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:29:59.333482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:29:59.335169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285aca64-61eb-4585-9685-d2e8a7c952ae service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:29:59.355542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 679/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:30:01.745791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:01.746325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:01.746808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:01.749500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 682/1361] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:01.757062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9507f-9aae-4754-9d16-9653c5863a99 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:01.757517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9507f-9aae-4754-9d16-9653c5863a99 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:01.757640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9507f-9aae-4754-9d16-9653c5863a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:01.827581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-88d9507f-9aae-4754-9d16-9653c5863a99 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:01.828828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-88d9507f-9aae-4754-9d16-9653c5863a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:01.868904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:01.933820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 680/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:02.227290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:02.228841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:02.401219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601d154-a505-4b93-a0d2-9b0924086c0f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:02.415091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:02.566671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:02.567279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:02.567558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:02.567837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:02.569554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:02.663681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:02.665201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bd533-b137-4883-8dd8-9030a5575bfe service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:02.686703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 683/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:05.168874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312be8e-6862-488c-8cfb-38cfdde654b2 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:05.169405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312be8e-6862-488c-8cfb-38cfdde654b2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:05.169405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312be8e-6862-488c-8cfb-38cfdde654b2 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:05.170941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 681/1364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:05.176062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95febed1-2ca9-4246-afba-fed3fc0b09c6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:05.176505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95febed1-2ca9-4246-afba-fed3fc0b09c6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:05.176691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95febed1-2ca9-4246-afba-fed3fc0b09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:05.194041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:05.249471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-95febed1-2ca9-4246-afba-fed3fc0b09c6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:05.251445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-95febed1-2ca9-4246-afba-fed3fc0b09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:05.353319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 684/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:05.669798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:05.670249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:05.670525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:05.672020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 682/1366] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 15:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:05.678496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700538b-5973-410b-93e7-b697e37c12c8 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:05.678874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700538b-5973-410b-93e7-b697e37c12c8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:05.679227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700538b-5973-410b-93e7-b697e37c12c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:05.762236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b700538b-5973-410b-93e7-b697e37c12c8 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:05.763703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b700538b-5973-410b-93e7-b697e37c12c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:05.807485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:05.892643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 685/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:05.900427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:05.902168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:06.062391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55ee6a-46fe-4455-895e-e6a5ea1bd901 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:06.084659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:06.183224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:06.183884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:06.184151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:06.184357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:06.185972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:06.282141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:06.283808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502be824-a0a4-48b4-9f8f-e990c359f209 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:06.303826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 683/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:06.468054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ccd-9a94-410d-9b5e-8e868b76daef None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:06.468608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ccd-9a94-410d-9b5e-8e868b76daef None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:06.468608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb445ccd-9a94-410d-9b5e-8e868b76daef None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:06.471824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 686/1369] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:06.476395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3adf0-e796-4eb7-8e7a-10b5ef210a85 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:06.476713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3adf0-e796-4eb7-8e7a-10b5ef210a85 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:06.476954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3adf0-e796-4eb7-8e7a-10b5ef210a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:06.513100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:06.559324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-52b3adf0-e796-4eb7-8e7a-10b5ef210a85 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:06.560622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-52b3adf0-e796-4eb7-8e7a-10b5ef210a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:06.671181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 684/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:07.002984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:07.002984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:07.002984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:07.002984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 687/1371] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 12 15:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:07.008841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644978-0676-4341-800f-2d4758169d18 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:07.009239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644978-0676-4341-800f-2d4758169d18 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:07.009617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d644978-0676-4341-800f-2d4758169d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:07.095883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5d644978-0676-4341-800f-2d4758169d18 None None] MFA Rules not processed for user `57733217d148407dbc9bce988253441e`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:07.097635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5d644978-0676-4341-800f-2d4758169d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:07.150992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:07.184572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 685/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 12 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:07.192709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:07.194361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:07.300568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2fd2-349f-4174-9f2e-d6fc84507630 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:07.349968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:07.391028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:07.391509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:07.391793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:07.392353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:07.396233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:07.528669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:07.530112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e5b1c-a53a-4b79-b2be-50d2b7ecdfa3 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:07.557764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 688/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:08.608506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:08.609055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:08.609055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:08.610970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 686/1374] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:08.616160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d07e-5edc-400e-9006-bfac9d00cc36 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:08.616573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d07e-5edc-400e-9006-bfac9d00cc36 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:08.616719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d07e-5edc-400e-9006-bfac9d00cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:08.687382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b139d07e-5edc-400e-9006-bfac9d00cc36 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:08.688658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b139d07e-5edc-400e-9006-bfac9d00cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:08.712614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:08.795131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 689/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:09.111602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:09.113117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:09.279289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8cdd3-b034-4220-8a22-8f263e7efdb7 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:09.332910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:09.397962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:09.398573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:09.398852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:09.399124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:09.400740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:09.506589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:09.508318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084de26-44e1-44c0-8041-1ce6ae94730e service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:09.531622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 687/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:11.771381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:11.771945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:11.771945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:11.773399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 690/1377] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:11.778653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287c2b-cbb3-46c3-8a44-8d57e6bb6ac3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:11.779061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287c2b-cbb3-46c3-8a44-8d57e6bb6ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:11.779261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5287c2b-cbb3-46c3-8a44-8d57e6bb6ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:11.850163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e5287c2b-cbb3-46c3-8a44-8d57e6bb6ac3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:11.851415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e5287c2b-cbb3-46c3-8a44-8d57e6bb6ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:11.859004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:11.960287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 688/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:12.249939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:12.253399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:12.419358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a93f4c-62de-4b7e-8d47-1fa45a75e10c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:12.426476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:12.546083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:12.546751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:12.547101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:12.548158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:12.549808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:12.645430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:12.647509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70560-153b-4e2f-bd4b-a879ca6b1f37 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:12.666819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 691/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:14.890774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:14.891932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:14.891932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:14.893329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 689/1380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:14.898660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16279aa2-a78c-4b83-a7af-65db0e0e5823 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:14.899084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16279aa2-a78c-4b83-a7af-65db0e0e5823 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:14.899206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16279aa2-a78c-4b83-a7af-65db0e0e5823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:14.911518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:14.973607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-16279aa2-a78c-4b83-a7af-65db0e0e5823 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:14.975013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-16279aa2-a78c-4b83-a7af-65db0e0e5823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:15.133720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 692/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:15.423309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:15.425100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:15.593257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:15.604718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822e01-66cb-4de1-83a2-3b5217f10be4 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:15.738995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:15.739757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:15.740216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:15.740510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:15.742519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:15.849807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:15.851358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f259a1-88b2-4003-b588-83eee1554eba service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:15.863736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:15.874706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 690/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:18.169935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:18.170655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:18.170655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:18.172107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 693/1383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:18.177893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401aff-811e-42c5-a316-2458fcea3b8d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:18.178481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401aff-811e-42c5-a316-2458fcea3b8d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:18.178481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1401aff-811e-42c5-a316-2458fcea3b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:18.260496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a1401aff-811e-42c5-a316-2458fcea3b8d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:18.262106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a1401aff-811e-42c5-a316-2458fcea3b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:18.373716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 691/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:30:18.661351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:18.662963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:18.752308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:18.817049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f3be1-87f6-4c0b-90d3-6c3fb7f09a6e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:18.935654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:18.936336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:18.936772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:18.937113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:18.939781 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:18.993208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:19.038364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:19.040075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2d2c9-6031-4153-a426-eecf61da8d25 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:19.058682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 694/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:21.387439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:21.387956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:21.387956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:21.389220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 692/1386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:30:21.395445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e229-c88b-4fdc-a03a-050da7b4701e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:21.395923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e229-c88b-4fdc-a03a-050da7b4701e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:21.396127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403e229-c88b-4fdc-a03a-050da7b4701e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:21.465448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a403e229-c88b-4fdc-a03a-050da7b4701e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:21.466685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a403e229-c88b-4fdc-a03a-050da7b4701e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:21.564817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 695/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:21.855673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:21.857181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:21.933035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:22.002148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b38ee5-91d2-4c64-bf9f-201b368bd53f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:22.114313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:22.114930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:22.115190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:22.115458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:22.117026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:22.157306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:22.208644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:22.210273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849963dd-85f3-48ab-b11a-e1decb176b7c service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:22.228366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 693/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:23.032328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a0e6-880e-480d-a41f-b88a3305a9e2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:23.033167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a0e6-880e-480d-a41f-b88a3305a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:23.033167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a0e6-880e-480d-a41f-b88a3305a9e2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:23.034723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 696/1389] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:23.039983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9375-3ef8-46ff-b549-bf10ba742dbb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:23.040440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9375-3ef8-46ff-b549-bf10ba742dbb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:23.040534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f9375-3ef8-46ff-b549-bf10ba742dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:23.107122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-180f9375-3ef8-46ff-b549-bf10ba742dbb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:23.108318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-180f9375-3ef8-46ff-b549-bf10ba742dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:23.206695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 694/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:23.507111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:23.507393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:23.507661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:23.508986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 697/1391] 10.222.0.23 () {54 vars in 966 bytes} [Mon Sep 12 15:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:23.514253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e071ae-959c-453a-9dc3-77c38e178042 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:23.514542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e071ae-959c-453a-9dc3-77c38e178042 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:23.514813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e071ae-959c-453a-9dc3-77c38e178042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:23.533280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:23.597198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f2e071ae-959c-453a-9dc3-77c38e178042 None None] MFA Rules not processed for user `039bd7079482417f8fc2727ee1ee1c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:23.598417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f2e071ae-959c-453a-9dc3-77c38e178042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:23.675231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 695/1392] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Sep 12 15:30:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:23.684422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:23.686616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:23.717868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:23.792220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b90a-1063-4b46-988c-ecf80d4f8052 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:23.871445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:23.872184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:23.872467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:23.872735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:23.874392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:23.958327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:23.992409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:23.993900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b672dc-109a-4fd8-a544-2412d1fffecc service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:24.012398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 698/1393] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:24.448802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c432f-afae-43a8-904d-f67d3c509423 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:24.449333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c432f-afae-43a8-904d-f67d3c509423 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:24.449567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c432f-afae-43a8-904d-f67d3c509423 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:24.451088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 696/1394] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:24.456177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:24.456609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:24.456780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:24.529140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:24.530365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:24.645487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 699/1395] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:24.800629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6fa3f-7b18-447d-86b9-f1e7e37d6e99 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:24.800921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6fa3f-7b18-447d-86b9-f1e7e37d6e99 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:24.801317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6fa3f-7b18-447d-86b9-f1e7e37d6e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:24.872335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b7b6fa3f-7b18-447d-86b9-f1e7e37d6e99 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:24.873533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b7b6fa3f-7b18-447d-86b9-f1e7e37d6e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:24.928855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:24.941756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:24.942935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:24.963037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 697/1396] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:24.982581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:25.014861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcacc-25f7-4932-88e6-628102df28ca None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:25.015163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcacc-25f7-4932-88e6-628102df28ca None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:25.016934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bcacc-25f7-4932-88e6-628102df28ca None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:25.017586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 698/1397] 10.222.0.23 () {54 vars in 943 bytes} [Mon Sep 12 15:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:30:25.025230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:25.025905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:25.026351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:25.068766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c4f13-5158-4087-9119-1755a64b0a37 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:25.108389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] MFA Rules not processed for user `504b251bfd13480a92e088d0f81d81ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:25.109619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:25.183391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:25.183997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:25.184274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:25.184540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:25.186155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:25.216395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 699/1398] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Sep 12 15:30:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:30:25.226019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:25.226652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:25.236307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c81f-936b-473c-8039-69dd037ec6f4 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:25.263649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:25.278078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:25.279670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984b7d5-00cc-4373-b932-da303e23df25 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:25.298576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 700/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:30:25.359624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:25.360680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:25.361179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:25.361685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:25.363849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:25.461114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:25.463530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0b0e-8e80-4e98-9098-5245155fc311 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:25.473593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 700/1400] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 15:30:27.536017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:27.536595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:27.536595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:27.539045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 701/1401] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:27.543331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b133321-600f-4431-b15d-aeedd9b046ad None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:27.543763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b133321-600f-4431-b15d-aeedd9b046ad None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:27.543877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b133321-600f-4431-b15d-aeedd9b046ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:27.616489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0b133321-600f-4431-b15d-aeedd9b046ad None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:27.617690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0b133321-600f-4431-b15d-aeedd9b046ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:27.624533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:27.728695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 701/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:30:28.022264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:28.023771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:28.193515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027099-2d72-4f68-ade2-fdced39fc2c7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:28.207966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:28.324728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:28.325353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:28.325750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:28.326105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:28.328000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:28.454780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:28.456055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfaef8-dae3-4d26-85a9-5004c4adeadf service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:28.483939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 702/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:30.693763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:30.694220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:30.694320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:30.698619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 702/1404] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:30.706696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd37a6-0d63-47f2-83dd-2e0697033cef None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:30.707215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd37a6-0d63-47f2-83dd-2e0697033cef None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:30.707215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd37a6-0d63-47f2-83dd-2e0697033cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:30.733655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:30.805344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-dacd37a6-0d63-47f2-83dd-2e0697033cef None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:30.806622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-dacd37a6-0d63-47f2-83dd-2e0697033cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:30.965904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 703/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:31.241224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:31.243112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:31.460443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:31.474489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72523-cbcd-4d60-b44a-6b956d35e07f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:31.647252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:31.649087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:31.650128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:31.652839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:31.655622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:31.780480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:31.785322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bad7d-6afe-4cbe-95c6-70bf22a7b117 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:31.796347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:31.811484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 703/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:34.082375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:34.082919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:34.083035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:34.085769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 704/1407] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:34.091292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c634-eb6d-4440-855a-6cd605d6ac14 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:34.092162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c634-eb6d-4440-855a-6cd605d6ac14 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:34.092497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912c634-eb6d-4440-855a-6cd605d6ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:34.185064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3912c634-eb6d-4440-855a-6cd605d6ac14 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:34.186392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3912c634-eb6d-4440-855a-6cd605d6ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:34.319743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 704/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:34.598707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:34.600214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:34.757092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:34.846237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f1d1a-a386-4efd-8a5c-34f34e5375df None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:35.005531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:35.006316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:35.006596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:35.006874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:35.008698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:35.076069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:35.114019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:35.116034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93db8-486e-4296-8c41-9b6a17db7b74 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:35.138501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 705/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:44.306833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=67 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:45.133357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=20 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:48.896869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016667-166b-4041-bf2b-a8893d0ce476 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:48.897442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016667-166b-4041-bf2b-a8893d0ce476 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:48.897442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016667-166b-4041-bf2b-a8893d0ce476 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:48.898784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 705/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 12 15:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:48.903805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb98b9-9cd1-438d-81e4-7d646ef2767a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:48.904265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb98b9-9cd1-438d-81e4-7d646ef2767a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:48.904373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb98b9-9cd1-438d-81e4-7d646ef2767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:48.979978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-59bb98b9-9cd1-438d-81e4-7d646ef2767a None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:48.981189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-59bb98b9-9cd1-438d-81e4-7d646ef2767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:49.085592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 706/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 12 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:49.100286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c72a1-50ef-4ee9-8093-20a601a83d86 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:49.100568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c72a1-50ef-4ee9-8093-20a601a83d86 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:49.100838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c72a1-50ef-4ee9-8093-20a601a83d86 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:49.102231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 706/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 12 15:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:49.107050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66c9c-1dcd-4482-ae6b-04fce6484c6c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:49.107336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66c9c-1dcd-4482-ae6b-04fce6484c6c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:49.107610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66c9c-1dcd-4482-ae6b-04fce6484c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:49.180199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:49.182876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d9f66c9c-1dcd-4482-ae6b-04fce6484c6c None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:49.184634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d9f66c9c-1dcd-4482-ae6b-04fce6484c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:49.300593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 707/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 12 15:30:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:51.865597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:51.866213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:51.866213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:51.867496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:51.872653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c89e-bfc8-4d43-9d8c-963c02d7949e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:51.873071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c89e-bfc8-4d43-9d8c-963c02d7949e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:51.873200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c89e-bfc8-4d43-9d8c-963c02d7949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:51.937929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3b81c89e-bfc8-4d43-9d8c-963c02d7949e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:51.939065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3b81c89e-bfc8-4d43-9d8c-963c02d7949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:51.992807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:52.035377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:52.325804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:52.327411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:52.473395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfce783-9789-4666-898a-d6f38b316634 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:52.543873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:52.583814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85199289-8290-4abd-879a-678742553e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:52.584344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199289-8290-4abd-879a-678742553e02 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:52.584619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199289-8290-4abd-879a-678742553e02 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:52.584886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85199289-8290-4abd-879a-678742553e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:52.586491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-85199289-8290-4abd-879a-678742553e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:52.687873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85199289-8290-4abd-879a-678742553e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:52.690088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85199289-8290-4abd-879a-678742553e02 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:52.715965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 708/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:53.853047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:53.853618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:53.853618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:53.855040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:53.861212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c39f3-c025-4804-b89f-82d55228f932 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:53.861642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c39f3-c025-4804-b89f-82d55228f932 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:53.861809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c39f3-c025-4804-b89f-82d55228f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:53.936401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9d3c39f3-c025-4804-b89f-82d55228f932 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:53.937513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9d3c39f3-c025-4804-b89f-82d55228f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:53.964682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:54.037039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:54.185218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:54.186839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:54.332040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab5eaa-78f2-4f79-9e9d-49ea99aa37a3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:54.377705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:54.451920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:54.452437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:54.452711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:54.452977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:54.454581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:54.542739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:54.544322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c879a18-f5e3-405f-ad39-28e0fc86235e service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:54.561938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 710/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:55.693197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:55.693668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:55.693942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:55.695384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:55.701803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34ab5-aa9c-429d-8db2-63c2656b7859 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:55.702226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34ab5-aa9c-429d-8db2-63c2656b7859 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:55.702330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34ab5-aa9c-429d-8db2-63c2656b7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:55.755183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:55.777804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d3a34ab5-aa9c-429d-8db2-63c2656b7859 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:55.779029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d3a34ab5-aa9c-429d-8db2-63c2656b7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:55.872699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:56.022419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:56.023932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:56.165268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d75eda-ac61-4287-bba8-74f4b4f48d7b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:56.177411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:56.274526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:56.275050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:56.275325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:56.275590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:56.277257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:56.368456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:56.370108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328d87c-2133-4630-ab3d-618de8ad1914 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:56.393238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 711/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:57.516065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:57.516612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:57.516612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:57.518009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:57.524342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c82b-3447-4b0c-bc3d-103c69713978 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:57.524772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c82b-3447-4b0c-bc3d-103c69713978 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:57.524890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892c82b-3447-4b0c-bc3d-103c69713978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:57.544879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:57.601268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c892c82b-3447-4b0c-bc3d-103c69713978 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:57.602508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c892c82b-3447-4b0c-bc3d-103c69713978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:57.697202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:57.878075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:57.879504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:57.987500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:58.023368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb85a48-4e54-43fc-9218-dbb40453720d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:30:58.134134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:30:58.134649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:58.134926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:58.135195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:58.136775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:58.329437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:58.343396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:30:58.345003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d029-22bf-4ccd-ba9e-39818f9ebda4 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:30:58.362532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 713/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:30:59.473206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:59.473888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:59.473888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:59.475096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:30:59.481230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11359-fa82-40ec-986d-49fdfe6727d0 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:30:59.481676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11359-fa82-40ec-986d-49fdfe6727d0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:30:59.481799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11359-fa82-40ec-986d-49fdfe6727d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:30:59.556645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1fb11359-fa82-40ec-986d-49fdfe6727d0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:30:59.557868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1fb11359-fa82-40ec-986d-49fdfe6727d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:59.651065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:30:59.803471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:30:59.804997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:30:59.888073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:30:59.949037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb39ba-d687-4c96-8459-9ddde6b17df8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:00.062473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:00.063489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:00.063769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:00.064040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:00.065648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:00.114247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:00.156417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:00.158049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9677-1ca6-4f91-aa0d-9ad9224cec7e service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:00.175544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 714/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:01.242125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:01.242683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:01.242683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:01.244034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:01.250325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac622-6302-4531-867f-458f32970478 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:01.250748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac622-6302-4531-867f-458f32970478 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:01.250865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac622-6302-4531-867f-458f32970478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:01.327638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-aebac622-6302-4531-867f-458f32970478 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:01.329188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-aebac622-6302-4531-867f-458f32970478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:01.427669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:01.576067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:01.577617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:01.631578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:01.731332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89f023-9d08-4129-a8a3-453b4cad0f94 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:01.842186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:01.842703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:01.842983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:01.843252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:01.844867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:01.851647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:01.932902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:01.934515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d4a76-6795-473c-a4be-83f52d7af7ac service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:01.952293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 716/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:02.996009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:02.996536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:02.996536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:02.997901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:03.004501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae474e0-5567-4400-9736-c08f0ce957fa None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:03.004954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae474e0-5567-4400-9736-c08f0ce957fa None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:03.005062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae474e0-5567-4400-9736-c08f0ce957fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:03.080178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1ae474e0-5567-4400-9736-c08f0ce957fa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:03.081377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1ae474e0-5567-4400-9736-c08f0ce957fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:03.147429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:03.175767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:03.332744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:03.334214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:03.351070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:03.476414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2562-597a-42bd-925e-c9dff0dee2cb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:03.565327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:03.590470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:03.590999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:03.591271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:03.591534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:03.593181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:03.681180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:03.682843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b27f7c-27a4-4cba-ab91-9d11fcf89a27 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:03.700887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 717/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:04.763484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:04.764028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:04.764028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:04.765382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:04.771955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1102-964a-4d64-ba45-826c319bb16c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:04.772441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1102-964a-4d64-ba45-826c319bb16c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:04.772552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f1102-964a-4d64-ba45-826c319bb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:04.848803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-438f1102-964a-4d64-ba45-826c319bb16c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:04.850040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-438f1102-964a-4d64-ba45-826c319bb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:04.890687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:04.944664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:05.091928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:05.093429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:05.236991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7de9-5719-4379-b707-91db38cfa791 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:05.290257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:05.347624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:05.348219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:05.348490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:05.348758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:05.350474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:05.445822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:05.447397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1b68-5366-4020-845a-0271d7e65859 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:05.465168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 719/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:06.531059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:06.532236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:06.532236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:06.533577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:06.539930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad57-c080-4714-aaf7-1cf2d357c35d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:06.540404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad57-c080-4714-aaf7-1cf2d357c35d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:06.540605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad57-c080-4714-aaf7-1cf2d357c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:06.614267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-70e7ad57-c080-4714-aaf7-1cf2d357c35d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:06.615476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-70e7ad57-c080-4714-aaf7-1cf2d357c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:06.617462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:06.711983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:06.862559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:06.863989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:07.007109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3a22-eebf-4f14-877f-2bdda2ed1acf None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:07.034996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:07.119041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:07.119600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:07.119878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:07.120145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:07.121754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:07.208355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:07.209970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8616-6185-4b01-bd96-d65274e5877c service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:07.227386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 720/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:09.274217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:09.274748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:09.274865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:09.276192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:09.282410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-9911-4630-a66e-780525fb9ce0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:09.282857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-9911-4630-a66e-780525fb9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:09.282966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194c172-9911-4630-a66e-780525fb9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:09.322506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:09.348119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9194c172-9911-4630-a66e-780525fb9ce0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:09.349314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9194c172-9911-4630-a66e-780525fb9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:09.445421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:09.756775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:09.758339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:09.865111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992c3f4-0a45-4cf3-a00f-7dec45c27d15 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:09.904663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:09.948334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:09.948836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:09.949112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:09.949382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:09.950999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:10.060515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:10.062042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d0c00-b51f-4b27-8de9-8ff4f05262ab service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:10.080757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 722/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:12.445627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:12.446200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:12.446200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:12.447554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:12.453212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09440eb-f7eb-414b-90a0-82c04683c7cf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:12.453917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09440eb-f7eb-414b-90a0-82c04683c7cf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:12.454209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09440eb-f7eb-414b-90a0-82c04683c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:12.518286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e09440eb-f7eb-414b-90a0-82c04683c7cf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:12.519462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e09440eb-f7eb-414b-90a0-82c04683c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:12.532462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:12.615097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:12.899215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:12.900741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:13.002392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a132d-b161-40b6-a416-ea7162df8c0b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:13.014780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:13.074815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:13.075411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:13.075689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:13.075958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:13.077537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:13.183369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:13.184721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd128-5c10-4b0a-81df-049acc9c7340 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:13.203266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 723/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:15.639946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:15.641133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:15.641133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:15.642484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:15.647666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbea9f-409e-4bb8-9323-7514483fa9ef None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:15.648119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbea9f-409e-4bb8-9323-7514483fa9ef None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:15.648216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbea9f-409e-4bb8-9323-7514483fa9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:15.697153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:15.715587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3ccbea9f-409e-4bb8-9323-7514483fa9ef None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:15.716791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3ccbea9f-409e-4bb8-9323-7514483fa9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:15.812759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:16.100441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:16.102032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:16.203547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae14381-7cc8-478e-82ae-9de73d9fd7cd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:16.242997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:16.277261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:16.277893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:16.278175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:16.278447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:16.280031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:16.387470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:16.388804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062245-58a5-447b-893a-e571f17f1639 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:16.409428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 725/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:18.671226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:18.672370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:18.672370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:18.673615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:18.678848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682dc7-e62c-431e-a49e-02e32959b61e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:18.679242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682dc7-e62c-431e-a49e-02e32959b61e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:18.679465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682dc7-e62c-431e-a49e-02e32959b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:18.749590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-06682dc7-e62c-431e-a49e-02e32959b61e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:18.750824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-06682dc7-e62c-431e-a49e-02e32959b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:18.770493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:18.846789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:19.128898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:19.130450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:19.231010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1986b-a4b0-4560-b005-3856da02eb0c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:19.251073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:19.304697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:19.305293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:19.305569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:19.305867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:19.307445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:19.417192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:19.418582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc047e4-b9e8-436a-9518-129eba230cf7 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:19.435960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 726/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:21.639884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:21.640461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:21.640461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:21.641785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:31:21.647179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d4f63-dd4a-4fff-966a-ad12bc87228d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:21.647586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d4f63-dd4a-4fff-966a-ad12bc87228d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:21.647729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d4f63-dd4a-4fff-966a-ad12bc87228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:21.710482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:21.713291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f02d4f63-dd4a-4fff-966a-ad12bc87228d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:21.715050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f02d4f63-dd4a-4fff-966a-ad12bc87228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:21.810773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:22.091831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:22.094003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:22.193196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b25c94-9388-4fcc-9a37-682b27163012 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:22.242086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:22.266454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:22.267045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:22.267318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:22.267583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:22.269139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:22.375191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:22.376548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2b983-4154-476c-a15d-3f7e72d5308d service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:22.394637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 728/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:24.616579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:24.617149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:24.617149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:24.618515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:24.624001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777532b-ebc8-4ba9-b758-74ea3fa47f14 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:24.624429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777532b-ebc8-4ba9-b758-74ea3fa47f14 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:24.624530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777532b-ebc8-4ba9-b758-74ea3fa47f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:24.690495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a777532b-ebc8-4ba9-b758-74ea3fa47f14 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:24.691704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a777532b-ebc8-4ba9-b758-74ea3fa47f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:24.720652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:24.787748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:25.074139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:25.075661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:25.177712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727a16a-c734-4f1c-b879-ecab1f3ddc02 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:25.205695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:25.250427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:25.251019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:25.251299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:25.251564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:25.253131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:25.370452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:25.371806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c0796-3927-4ac2-9cb1-c40a8953038f service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:25.391023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 729/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:27.593760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:27.594344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:27.594344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:27.595668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:27.601452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d313-66ec-455e-ac76-d81e4ce520cf None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:27.601919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d313-66ec-455e-ac76-d81e4ce520cf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:27.602033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d313-66ec-455e-ac76-d81e4ce520cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:27.668201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-fc79d313-66ec-455e-ac76-d81e4ce520cf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:27.669393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fc79d313-66ec-455e-ac76-d81e4ce520cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:27.677531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:27.766123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:31:28.050441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:28.052020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:28.152674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a86b8-4b6d-47d7-a112-fefa0d3b1f70 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:28.207418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:28.225156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:28.225801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:28.226096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:28.226361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:28.227918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:28.334625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:28.335970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17012e77-b614-4fc1-850b-cbf29cb17a07 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:28.354175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 731/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:30.544744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:30.545395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:30.545395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:30.547170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:30.552407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec0a7-a6e2-490d-a16e-64c96be49ff1 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:30.552838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec0a7-a6e2-490d-a16e-64c96be49ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:30.552944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ec0a7-a6e2-490d-a16e-64c96be49ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:30.618409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fc8ec0a7-a6e2-490d-a16e-64c96be49ff1 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:30.619606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fc8ec0a7-a6e2-490d-a16e-64c96be49ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:30.657064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:30.715284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:30.994769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:30.996285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:31.098379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d53d6-b229-4f3a-b1f4-6e5031a93100 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:31.135422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:31.170071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:31.171181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:31.171454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:31.171724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:31.173299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:31.278718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:31.280068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b5ab3-63d1-4a46-ae34-a5f6e89e0232 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:31.298381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 732/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:33.447886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:33.448424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:33.448424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:33.450039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:33.455304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a7d5-5827-4f4a-b415-4673efddfeb4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:33.455713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a7d5-5827-4f4a-b415-4673efddfeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:33.455843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a7d5-5827-4f4a-b415-4673efddfeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:33.520011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6439a7d5-5827-4f4a-b415-4673efddfeb4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:33.521183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6439a7d5-5827-4f4a-b415-4673efddfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:33.538657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:33.616595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:33.897861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:33.899450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:34.003233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5b8d-d96c-46c9-a2ef-cf52f8b1d46f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:34.068640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:34.075809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:34.076400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:34.076678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:34.077435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:34.079062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:34.187339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:34.188694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea3bc4-6cd0-4a73-9d59-f3a92e79afc1 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:34.206601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 734/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:36.418703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:36.419277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:36.419277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:36.420651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:36.426141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad24b5-abb4-4292-99ce-6bcd4ba553e4 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:36.426566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad24b5-abb4-4292-99ce-6bcd4ba553e4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:36.426676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad24b5-abb4-4292-99ce-6bcd4ba553e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:36.490931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c4ad24b5-abb4-4292-99ce-6bcd4ba553e4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:36.492132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c4ad24b5-abb4-4292-99ce-6bcd4ba553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:36.539249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:36.588374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:36.870590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:36.872111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:36.973466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff02d3a-7b66-48d8-a9be-38480a88b7b6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:37.022141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:37.049091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:37.049688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:37.049993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:37.050258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:37.051826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:37.163679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:37.165096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2a150-9652-4cc5-9a84-a908346363f9 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:37.183373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 735/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:31:46.586734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=22 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:47.181055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=66 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:57.122739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c5e1-01de-45ee-afc1-10853047b86e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:57.123264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c5e1-01de-45ee-afc1-10853047b86e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:57.123264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c5e1-01de-45ee-afc1-10853047b86e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:57.124653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 736/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:57.130115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db089-1733-492d-96f9-5f7273cc6c86 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:57.130565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db089-1733-492d-96f9-5f7273cc6c86 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:57.130666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db089-1733-492d-96f9-5f7273cc6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:57.195387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-581db089-1733-492d-96f9-5f7273cc6c86 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:57.196581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-581db089-1733-492d-96f9-5f7273cc6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:57.290931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 736/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:57.588102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:57.588387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:57.588662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:57.590040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 737/1473] 10.222.0.23 () {54 vars in 966 bytes} [Mon Sep 12 15:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:31:57.594874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a861be-29cd-4234-8785-f8c3d0902666 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:57.595158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a861be-29cd-4234-8785-f8c3d0902666 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:57.595430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a861be-29cd-4234-8785-f8c3d0902666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:57.669648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d1a861be-29cd-4234-8785-f8c3d0902666 None None] MFA Rules not processed for user `039bd7079482417f8fc2727ee1ee1c31`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:31:57.670868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d1a861be-29cd-4234-8785-f8c3d0902666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:57.691556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:57.747137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 737/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Sep 12 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:31:57.755736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:31:57.757283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:57.860683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8bd7-b229-48f3-82b7-1cd324a91b7c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:31:57.932602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:31:57.933192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:31:57.933461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:31:57.933722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:31:57.935809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:31:57.989047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:31:58.042355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:31:58.043771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a8f02-d6cb-41aa-a08b-84baffe70916 service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:31:58.063395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 738/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:00.319501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:00.320039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:00.320039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:00.321317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 738/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 15:32:00.327323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa551-de43-4cf5-85d6-56692dbc018d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:00.327754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa551-de43-4cf5-85d6-56692dbc018d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:00.327887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa551-de43-4cf5-85d6-56692dbc018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:00.392547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e22aa551-de43-4cf5-85d6-56692dbc018d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:00.393799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e22aa551-de43-4cf5-85d6-56692dbc018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:00.489404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 739/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:32:00.769258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:00.770842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:00.901436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca077806-be0b-420a-b4d0-d998e101ae55 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:01.066137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:01.110611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:01.111208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:01.111485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:01.111756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:01.112381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:01.114128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:32:01.114128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:32:01.114128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:32:01.115251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03e343-bfb7-4358-8b2b-6e5238568844 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:01.134109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 739/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 15:32:00 2022] GET /identity/v3/projects => generated 2553 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:32:03.298172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:03.298730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:03.298730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:03.300066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 740/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:32:03.305478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ff45-4239-4948-95cb-4c39572c7d24 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:03.305931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ff45-4239-4948-95cb-4c39572c7d24 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:03.306066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ff45-4239-4948-95cb-4c39572c7d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:03.371054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-59c0ff45-4239-4948-95cb-4c39572c7d24 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:03.372161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-59c0ff45-4239-4948-95cb-4c39572c7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:03.468379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 740/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:32:03.760893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:03.762457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:03.772228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:03.907722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c05bbe-a448-4ff4-880d-7a725a160c6e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:03.990975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:04.023180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:04.023783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:04.024062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:04.024337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:04.025954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:04.114731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:04.116368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cb6e7-d2d9-4c76-9efb-ee926d386cbe service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:04.134439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 741/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:06.483780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:06.484365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:06.484365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:06.485658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 741/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:32:06.490835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1721-a4d6-4b91-804b-ebe2952103bd None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:06.491236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1721-a4d6-4b91-804b-ebe2952103bd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:06.491386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b1721-a4d6-4b91-804b-ebe2952103bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:06.556214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-731b1721-a4d6-4b91-804b-ebe2952103bd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:06.557416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-731b1721-a4d6-4b91-804b-ebe2952103bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:06.602712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:06.652235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 742/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:32:06.940123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:06.941646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:06.965457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:07.044043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837c2b0-33d6-4d7f-a65a-17f330e8e444 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:07.133447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:07.134065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:07.134338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:07.134602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:07.136160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:07.208877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:07.243072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:07.244515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f402c9b-09ba-4cb8-970d-0b60c20b07c9 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:07.262711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 742/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:09.460748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:09.461283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:09.461283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:09.462629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 743/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:32:09.468328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41909-8cb1-4eaa-b6a3-f82c8a6e01cc None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:09.468779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41909-8cb1-4eaa-b6a3-f82c8a6e01cc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:09.468877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41909-8cb1-4eaa-b6a3-f82c8a6e01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:09.535929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-77d41909-8cb1-4eaa-b6a3-f82c8a6e01cc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:09.537138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-77d41909-8cb1-4eaa-b6a3-f82c8a6e01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:09.631320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 743/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:32:09.918785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:09.920324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:10.024374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fc37c-d729-49ec-b8dc-a68e21626f8f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:10.094956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:10.096596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:10.097246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:10.097557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:10.098086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:10.100131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:10.207647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:10.208995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1118dc-5646-4c97-8ebe-065680d885c8 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:10.227425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 744/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:12.493775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:12.494315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:12.494315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:12.495949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 744/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:32:12.501229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914be-e6f1-4acc-b092-680471fa1dcc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:12.501712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914be-e6f1-4acc-b092-680471fa1dcc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:12.501848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b914be-e6f1-4acc-b092-680471fa1dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:12.576819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-86b914be-e6f1-4acc-b092-680471fa1dcc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:12.578162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-86b914be-e6f1-4acc-b092-680471fa1dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:12.632373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:12.678344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 745/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:32:12.977084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:12.978641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:13.016290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:13.086611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d62a-147f-4b43-b23b-f26d4c667e25 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:13.163035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:13.163775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:13.164056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:13.164323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:13.166098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:13.248722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:13.279840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:13.281529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd724b-adf0-4c86-a08c-4cd5df0f8aa0 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:13.300626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 745/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:15.664403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:15.664959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:15.664959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:15.666319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 746/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 15:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:32:15.672329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786b10-d02e-4b7e-adb1-7a2e2cd64453 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:15.672796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786b10-d02e-4b7e-adb1-7a2e2cd64453 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:15.672904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786b10-d02e-4b7e-adb1-7a2e2cd64453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:15.740039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-84786b10-d02e-4b7e-adb1-7a2e2cd64453 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:32:15.741304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-84786b10-d02e-4b7e-adb1-7a2e2cd64453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:15.837381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 746/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:32:16.128711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:32:16.130349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:16.235321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfc326-9a30-409c-b78b-891c004743ec None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:32:16.310647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:32:16.311248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:32:16.311521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:32:16.311788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:32:16.313794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:32:16.323017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:16.430231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:32:16.431706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606ae79-4875-49ae-b303-9b5040a99834 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:32:16.450362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 747/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:32:25.835423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=82 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:32:26.447292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=50 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:29.226300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:29.226817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:29.226927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:29.302604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:33:29.303806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:29.398820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 747/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:33:29.406951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:29.407443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:29.407546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:29.482961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:33:29.484158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:29.577145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 748/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:33:29.581786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:29.583008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:29.594346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b52b-b2fd-4bf5-85d6-ba89e1afbbee None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:29.653509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:29.687228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:29.687719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:29.687991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:29.688255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:29.688885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:33:29.689180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:29.690212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:29.690212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:33:29.690212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:33:29.691083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:29.702163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 748/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:33:29.710336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:29.719262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a2e57-e6e0-4591-9ce1-9abc85353dde None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:29.779864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:29.815530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:29.816136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:29.816413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:29.816683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:29.817304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:29.819057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:29.819057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:33:29.819057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:33:29.820247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:29.875718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 749/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:33:29 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:33:29.879930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:29.881436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:29.914309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6ffd-3407-4b08-bf43-879a567e2d47 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:30.007340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:30.007935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.008206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.008473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.009093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:30.010704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:30.010704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:33:30.010704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:33:30.011901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:30.054227 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 749/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:33:29 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:33:30.058983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:30.060508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.120420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2cdf1-8c57-4ba3-aa1d-59d2c63ca6a8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:30.201354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:30.212575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:30.213199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.213473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.214265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.214363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:30.215394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:30.215394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:33:30.215394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:33:30.216267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:30.228370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 750/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:33:30.232972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:30.234524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.246282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f284f-cba6-4dde-beba-20165b5d55c3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:30.270497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:30.339692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:30.340307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.340581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.340847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.341477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:30.342515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:30.342515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:33:30.342515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:33:30.343389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc13395-81ea-4a36-a8a1-136f748b8419 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:30.355392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 750/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:33:30.359539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:30.361087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.394284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45fb228-f78c-41f6-96ce-05a7591346d9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:30.487587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:30.488240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.488494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.488761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] PATH_INFO: `/v3/projects/efe64cb4d00842599aa5b84af05a1ef2/users/5564aae627af4fddad9bc5367adad385/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.510959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe64cb4d00842599aa5b84af05a1ef2, user_id=5564aae627af4fddad9bc5367adad385, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:30.511966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:30.511966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:33:30.511966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:33:30.513923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6582c99-5b59-4543-b79a-7f8bc969c2d2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:30.538208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 751/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:33:30 2022] PUT /identity/v3/projects/efe64cb4d00842599aa5b84af05a1ef2/users/5564aae627af4fddad9bc5367adad385/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:33:30.550236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0396d42-7806-4631-940a-932661cd3a22 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.550526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0396d42-7806-4631-940a-932661cd3a22 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.550792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0396d42-7806-4631-940a-932661cd3a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.606600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c0396d42-7806-4631-940a-932661cd3a22 None None] MFA Rules not processed for user `5564aae627af4fddad9bc5367adad385`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:33:30.607787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c0396d42-7806-4631-940a-932661cd3a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.687392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 751/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:33:30.701325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.701602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.701904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.703235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 752/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 12 15:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:33:30.708051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e82fc-b4a7-47d9-86f2-ffd821492e37 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:30.708332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e82fc-b4a7-47d9-86f2-ffd821492e37 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:30.708599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e82fc-b4a7-47d9-86f2-ffd821492e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:30.738742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:30.783219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ae5e82fc-b4a7-47d9-86f2-ffd821492e37 None None] MFA Rules not processed for user `57733217d148407dbc9bce988253441e`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:33:30.784408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ae5e82fc-b4a7-47d9-86f2-ffd821492e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.855966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 752/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 12 15:33:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:33:30.863755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:30.865260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:30.915110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:30.968776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e258c6-fe30-484e-9357-cc60c68995c2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:31.042117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:31.042647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:31.042924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:31.043190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:31.044771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:31.142354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:31.143778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:31.147193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:31.162954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 753/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:33:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:33:31.207822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf47bc8-7317-4762-b87c-bf8312fbe502 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:31.208111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf47bc8-7317-4762-b87c-bf8312fbe502 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:31.208384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf47bc8-7317-4762-b87c-bf8312fbe502 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:31.209617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 753/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Sep 12 15:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:33:31.213931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:31.215142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:31.312637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8263f-846e-4fa1-888b-bf7b7c46d02d service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:31.411287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:31.411910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:31.412186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:31.412451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] PATH_INFO: `/v3/users/5564aae627af4fddad9bc5367adad385` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:31.425132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5564aae627af4fddad9bc5367adad385)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:31.426178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:31.426178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:33:31.426178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:33:31.427385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:31.437534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:31.496376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5564aae627af4fddad9bc5367adad385'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:31.507694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5564aae627af4fddad9bc5367adad385'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:31.508460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5564aae627af4fddad9bc5367adad385'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:31.509133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5564aae627af4fddad9bc5367adad385'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:31.537235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5564aae627af4fddad9bc5367adad385'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:31.556337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 754/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:33:31 2022] DELETE /identity/v3/users/5564aae627af4fddad9bc5367adad385 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:33:31.561215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:31.561758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:31.561872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:31.617357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:33:31.618522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:31.695853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:31.709254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 754/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:33:31.719288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:31.720514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:31.820669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715c5a5-04c6-4891-98b1-a0234a73ed31 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:31.875145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:31.895836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:31.896438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:31.896712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:31.896980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:31.898582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:32.006675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:32.008105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ccc6c-3200-4fd4-bcc0-0dc450cca386 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:32.026592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 755/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:33:32.383352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:33:32.384570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:33:32.396374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79e8a6-2bc8-4479-9efa-ca864db0db8b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:33:32.491102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:33:32.491781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:33:32.492062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:33:32.492332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] PATH_INFO: `/v3/projects/efe64cb4d00842599aa5b84af05a1ef2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:33:32.502621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe64cb4d00842599aa5b84af05a1ef2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:33:32.503643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:33:32.503643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:33:32.503643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:33:32.504848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:33:32.562939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe64cb4d00842599aa5b84af05a1ef2', 'request_id': 'req-9f11b36b-5464-431c-8917-60c1caedca10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:32.572109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe64cb4d00842599aa5b84af05a1ef2', 'request_id': 'req-9f11b36b-5464-431c-8917-60c1caedca10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:32.584843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe64cb4d00842599aa5b84af05a1ef2', 'request_id': 'req-9f11b36b-5464-431c-8917-60c1caedca10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:32.607170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] The token cache is being invalidate because project efe64cb4d00842599aa5b84af05a1ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:33:32.607453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:32.607878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9f11b36b-5464-431c-8917-60c1caedca10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:33:32.609246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 755/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:33:32 2022] DELETE /identity/v3/projects/efe64cb4d00842599aa5b84af05a1ef2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:33:42.023787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=62 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:33:42.605158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:35:09.664969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:09.665604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:09.665604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:09.666991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:09.671728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997907-a70e-4107-9eb6-60d724b4e1a4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:09.672179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997907-a70e-4107-9eb6-60d724b4e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:09.672286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997907-a70e-4107-9eb6-60d724b4e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:09.750759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c3997907-a70e-4107-9eb6-60d724b4e1a4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:09.751968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c3997907-a70e-4107-9eb6-60d724b4e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:09.857078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:10.010148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:10.012444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:10.129161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b9aa-5b2a-44d9-9456-72a623a951c1 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:10.134589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:10.135182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:10.135458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:10.135724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:10.143477 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:10.145022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239f10-a6ac-43ef-b60c-b28304fc922a service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:10.154710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 757/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:11.238264 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efe09-6cab-4bea-b4a7-bec428492ace None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:11.238717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efe09-6cab-4bea-b4a7-bec428492ace None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:11.238829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271efe09-6cab-4bea-b4a7-bec428492ace None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:11.240153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:11.246784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f6ed-45d3-413e-9a50-d172e83c3125 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:11.247216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f6ed-45d3-413e-9a50-d172e83c3125 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:11.247371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f6ed-45d3-413e-9a50-d172e83c3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:11.266543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c438f6ed-45d3-413e-9a50-d172e83c3125 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:11.267741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c438f6ed-45d3-413e-9a50-d172e83c3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:11.275478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:11.427987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efe09-6cab-4bea-b4a7-bec428492ace None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:11.442649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271efe09-6cab-4bea-b4a7-bec428492ace None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:11.447928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:11.448515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:11.448793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:11.449064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:11.456875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:11.458560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62b031-f7cf-4092-8a24-238337091045 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:11.468128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 758/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:11.709304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a5bb-d9ef-480b-9ed5-3684b05cf9af None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:11.709528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a5bb-d9ef-480b-9ed5-3684b05cf9af None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:11.709825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200a5bb-d9ef-480b-9ed5-3684b05cf9af None None] PATH_INFO: `/v3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:11.711632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 759/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Sep 12 15:35:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:35:11.718644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51517-1675-4d01-8d72-0d3995265116 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:11.718934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51517-1675-4d01-8d72-0d3995265116 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:11.719211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f51517-1675-4d01-8d72-0d3995265116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:11.777932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b8f51517-1675-4d01-8d72-0d3995265116 None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:11.779129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b8f51517-1675-4d01-8d72-0d3995265116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:11.795974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:35:11.849722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 759/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Sep 12 15:35:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:20.859967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942cf9-ba39-42b3-9959-1073210be25a None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:20.860437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942cf9-ba39-42b3-9959-1073210be25a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:20.860541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942cf9-ba39-42b3-9959-1073210be25a None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:20.861875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 760/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 12 15:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:20.867267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c5cd-2e39-433a-a105-a03f0c5a1e4c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:20.868200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c5cd-2e39-433a-a105-a03f0c5a1e4c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:20.868464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677c5cd-2e39-433a-a105-a03f0c5a1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:20.889603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e677c5cd-2e39-433a-a105-a03f0c5a1e4c None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:20.890823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e677c5cd-2e39-433a-a105-a03f0c5a1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:20.899618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 760/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 12 15:35:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:20.907517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e942cf9-ba39-42b3-9959-1073210be25a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:20.920863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e942cf9-ba39-42b3-9959-1073210be25a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:20.926255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:20.926832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:20.927104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:20.927368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:20.936096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:20.937592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce331c-a3c4-4b26-be68-233a04598d89 service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:20.946900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 761/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:22.937407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4435e-b76f-459f-8fbd-cbce7d8dc01b None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:22.937967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4435e-b76f-459f-8fbd-cbce7d8dc01b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:22.937967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4435e-b76f-459f-8fbd-cbce7d8dc01b None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:22.939268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:22.945164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095af8-be10-4d89-a1ca-06b94e282709 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:22.945579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095af8-be10-4d89-a1ca-06b94e282709 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:22.945707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7095af8-be10-4d89-a1ca-06b94e282709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:22.965324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e7095af8-be10-4d89-a1ca-06b94e282709 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:22.966549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e7095af8-be10-4d89-a1ca-06b94e282709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:22.974245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:23.126864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4435e-b76f-459f-8fbd-cbce7d8dc01b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:23.141855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4435e-b76f-459f-8fbd-cbce7d8dc01b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:23.147101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:23.147682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:23.147952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:23.148220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:23.156923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:23.158515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b826-6dde-4e0d-9be2-99d216e51617 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:23.167522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 762/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:24.232464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e54b2-995f-46d8-9d54-dbca9ff051ba None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:24.233045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e54b2-995f-46d8-9d54-dbca9ff051ba None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:24.233045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e54b2-995f-46d8-9d54-dbca9ff051ba None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:24.234372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:24.240488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566e80-0464-451d-8b30-a1a7ed2d612e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:24.240936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566e80-0464-451d-8b30-a1a7ed2d612e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:24.241033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc566e80-0464-451d-8b30-a1a7ed2d612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:24.261238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bc566e80-0464-451d-8b30-a1a7ed2d612e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:24.262477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bc566e80-0464-451d-8b30-a1a7ed2d612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:24.270240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 15:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:24.436586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e54b2-995f-46d8-9d54-dbca9ff051ba None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:24.450682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e54b2-995f-46d8-9d54-dbca9ff051ba None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:24.455910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:24.456490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:24.456765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:24.457032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:24.465276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:24.466862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578726f-7c5c-4009-a552-9ca9e34cbfc0 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:24.475802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 764/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:28.618976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:28.619981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:28.620096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:28.621461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:28.626795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7ee0-38d0-4ba5-ab5b-1c6c4cf801b4 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:28.627215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7ee0-38d0-4ba5-ab5b-1c6c4cf801b4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:28.627344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c7ee0-38d0-4ba5-ab5b-1c6c4cf801b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:28.646649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-246c7ee0-38d0-4ba5-ab5b-1c6c4cf801b4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:28.647852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-246c7ee0-38d0-4ba5-ab5b-1c6c4cf801b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:28.656178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:28.974459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:28.976146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:29.052881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930fc89-42ed-4c2c-9119-50f3c7fb433c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:29.056370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:29.056965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:29.057244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:29.057514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:29.066344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:29.067967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714eb4b-a6cb-4de2-acbd-677fdedd02c7 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:29.079481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 765/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:31.211130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:31.211662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:31.211765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:31.213035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:31.218351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514a7c-3ca3-414d-9365-5cdd8e4a2122 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:31.218793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514a7c-3ca3-414d-9365-5cdd8e4a2122 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:31.218898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce514a7c-3ca3-414d-9365-5cdd8e4a2122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:31.238443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ce514a7c-3ca3-414d-9365-5cdd8e4a2122 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:31.239629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ce514a7c-3ca3-414d-9365-5cdd8e4a2122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:31.247829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:31.538731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:31.540402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:31.553559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c32e88-5004-4094-bd42-f055ba93d389 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:31.557605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:31.558234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:31.558507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:31.558772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:31.567598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:31.568997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c186f-c9db-412e-baf0-c5d844501c63 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:31.578251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 767/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:35.238124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:35.238599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:35.238708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:35.240047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:35.245954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83695d-2ccc-4bff-91a2-db2e5f2d47dc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:35.246397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83695d-2ccc-4bff-91a2-db2e5f2d47dc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:35.246500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83695d-2ccc-4bff-91a2-db2e5f2d47dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:35.253945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=81 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:35:35.266586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0a83695d-2ccc-4bff-91a2-db2e5f2d47dc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:35.267767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0a83695d-2ccc-4bff-91a2-db2e5f2d47dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:35.275354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:35.588885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:35.590574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:35.652498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:35:35.666720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cec75a-9ac4-4489-b997-5c608159cf47 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:35.670250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:35.670837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:35.671109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:35.671376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:35.680260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:35.681744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e33c2d-b235-47b4-94f6-06db7e1a8e86 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:35.691137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 768/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:37.844073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:37.844637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:37.844637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:37.846015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:35:37.851276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63fa6-fab2-4e61-8761-e1d24d94affa None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:37.851711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63fa6-fab2-4e61-8761-e1d24d94affa None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:37.851819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc63fa6-fab2-4e61-8761-e1d24d94affa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:37.872464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5cc63fa6-fab2-4e61-8761-e1d24d94affa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:35:37.873755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5cc63fa6-fab2-4e61-8761-e1d24d94affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:37.881491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:35:38.191156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:35:38.192844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:35:38.206089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6503049-b633-40a9-b13d-7bf47271d0c7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:35:38.209532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:35:38.210155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:35:38.210435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:35:38.210707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:35:38.219886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:35:38.221291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507b44-feca-4a3d-b398-ebf59096f531 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:35:38.230476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 770/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:35:47.866675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=11 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:35:48.226337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=8 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:12.771861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75e27-dde2-4dff-9f89-01ba92e1ea03 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.775154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75e27-dde2-4dff-9f89-01ba92e1ea03 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.775154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75e27-dde2-4dff-9f89-01ba92e1ea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.807560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b6e75e27-dde2-4dff-9f89-01ba92e1ea03 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:12.809180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b6e75e27-dde2-4dff-9f89-01ba92e1ea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:12.823759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 770/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:12.833073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.833708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c972-63cd-4401-ad32-53cf75613dfa None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.833708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c972-63cd-4401-ad32-53cf75613dfa None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.833708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c972-63cd-4401-ad32-53cf75613dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.834643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.835145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.864266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a505c972-63cd-4401-ad32-53cf75613dfa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:12.865613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a505c972-63cd-4401-ad32-53cf75613dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:12.867523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:12.869130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:12.883962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 771/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:12.886278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456df4-7a5b-4f02-ab05-81fa2f20a013 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.886566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456df4-7a5b-4f02-ab05-81fa2f20a013 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.886926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456df4-7a5b-4f02-ab05-81fa2f20a013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.893799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 771/1542] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:12.895179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:12.913757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd117-4cfc-4e1e-8666-2f7705ac24db None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:12.927292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:12.944269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.945894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.946692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.948652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:12.957766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e9456df4-7a5b-4f02-ab05-81fa2f20a013 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:12.957766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e9456df4-7a5b-4f02-ab05-81fa2f20a013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:12.959253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:12.960546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:12.960546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:37:12.960546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:37:12.964515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aba19-32d8-4425-a49d-75a8ee44d0f0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:12.979870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 772/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:12.981224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.981510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.981798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:12.991917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 772/1544] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:12.993601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:12.998373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:12.998924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.035275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.036885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.048029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.049498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.057394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 773/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.058673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.074624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 773/1546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.075627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.091524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e321-bd78-4c32-becf-a2af37b31d9e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.106995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716aa3b-b92c-43be-9002-56fb7f830073 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.110507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.111288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.111500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.111786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.117754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.117754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.117754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.122346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.123233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.123750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.124244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.125093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.127264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4090ced-12ad-4f28-b413-96cd1bbcc2ec admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.142930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 774/1547] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.143974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.158882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592415c0-4683-4f1b-93c3-aa4d0f8f4ecd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.177763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.177763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.177763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.177763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.178237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.178237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.186690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.199911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 774/1548] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.201700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.202247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.202758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.205106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 775/1549] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.206098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.223529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2154ff3-bd62-4211-87f4-9202666e0cd8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.239503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.240746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.287668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.288270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.288545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.288816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.289442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.290492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:13.290492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:37:13.290492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:37:13.292340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.308120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 775/1550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.315465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.319243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a703dd5-0ad1-4e63-a70a-09a2038935f7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.324075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.324826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.325057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.325295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.325949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.330156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:13.330156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:37:13.330156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:37:13.330458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 776/1551] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.330458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.330658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4d22f-d248-48e1-a440-0438e0e9c990 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.350449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 776/1552] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.351757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134362d-62d7-434b-a67a-f9d4875326e7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.351974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134362d-62d7-434b-a67a-f9d4875326e7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.352246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134362d-62d7-434b-a67a-f9d4875326e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.372654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3134362d-62d7-434b-a67a-f9d4875326e7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.373865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3134362d-62d7-434b-a67a-f9d4875326e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.399894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de178347-96a1-4211-8793-7f8face0cfe9 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.405494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.406133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.406894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.407170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.408065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.410407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75bc3-8b23-4217-a237-8a53a50716e7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.441980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 777/1553] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.443339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533d0c-b8f9-41f5-a73d-25ad1127b61c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.443771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533d0c-b8f9-41f5-a73d-25ad1127b61c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.444043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b533d0c-b8f9-41f5-a73d-25ad1127b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.448778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 777/1554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.451452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4223-3649-4c86-b161-4f0bcec375d5 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.451787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4223-3649-4c86-b161-4f0bcec375d5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.452093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e4223-3649-4c86-b161-4f0bcec375d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.468533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7b533d0c-b8f9-41f5-a73d-25ad1127b61c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.469798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7b533d0c-b8f9-41f5-a73d-25ad1127b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.471663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-de3e4223-3649-4c86-b161-4f0bcec375d5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.472816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-de3e4223-3649-4c86-b161-4f0bcec375d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.482052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:13.492925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:13.530404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 778/1555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.538298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.538298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.538298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.538572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 778/1556] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.538572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.538572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.538572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.557035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.557302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.558254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.558488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.566246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 779/1557] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.569902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 779/1558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.570061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.570175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.580120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d25bc-db66-424a-aae4-0b4a8bc2e997 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.580528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42109-89c2-4efe-8368-ea55aeef7538 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.584669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.585248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.585372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.585523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.585822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.585940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.586203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.586438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.586548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.587096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.588370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad529d-afd5-4d08-99c7-a9593b9142cd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.588709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.598930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 780/1559] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:13.599757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.612232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd978-4227-4d0b-b2d2-516bd091e6df admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.612727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 780/1560] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.613984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b714-5676-4b83-ac4a-b1420d230240 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.614370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b714-5676-4b83-ac4a-b1420d230240 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.614643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09b714-5676-4b83-ac4a-b1420d230240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.618169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.618772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.619555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.619827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.620434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.622365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a08d2-d403-4b62-8c6c-6179827e4611 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.636582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ba09b714-5676-4b83-ac4a-b1420d230240 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.637901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ba09b714-5676-4b83-ac4a-b1420d230240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.645287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 781/1561] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.646615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.646905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.647039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 781/1562] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.650956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.651120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40903b-f7d1-4a7b-abda-324449a757d5 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.651120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40903b-f7d1-4a7b-abda-324449a757d5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.651120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40903b-f7d1-4a7b-abda-324449a757d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.667755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.668939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.670043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1f40903b-f7d1-4a7b-abda-324449a757d5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.671209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1f40903b-f7d1-4a7b-abda-324449a757d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.677566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 782/1563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.678461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.679042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 782/1564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.680193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.686083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.686388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.692270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc300ae-e810-4ae6-aa30-a689f38c3b83 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.696957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.698184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.698461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.698729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.699373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.699672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.701262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.709831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:13.710956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:13.719486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 783/1565] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.719486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.723090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 783/1566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:13.724621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.728678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66017d5d-2689-4fd2-a866-b8e0a7aa4107 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.733068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac17b5-6551-483d-860a-597e16e205c7 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.733878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.734460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.735670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.735670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.735670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.737201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.738414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.738985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.739259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.739528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.740262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.741915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.748663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 784/1567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:13.749502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.755155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 784/1568] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:13.755155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.759222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23541c-f387-48b4-8280-9ad2de94ac41 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.764422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.764965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd9968-4528-4e31-8569-7ad014675b0a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.765068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.765259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.765540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.766232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.767810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.769552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.770145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.770445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.770715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.771337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.771639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.773181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.777897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 785/1569] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:13.778518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.791335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 785/1570] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.791335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.794705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd70d6-cc0d-4a6c-9413-17b80e1a9d95 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.796658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f23bfd-222a-4233-b3d5-ac2b2914d1f6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.799261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.799888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.800172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.800444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.801108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.801235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.801462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.801777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.802048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.802316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.802934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.803088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.803233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.804775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.815447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 786/1571] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.816219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.817141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 786/1572] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.818008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.828475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0450f-7633-458c-8c4a-d13f64747604 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.829257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637357-d2e4-4bb9-9354-6e6a6c7ed767 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.833189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.833813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.834147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.834300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.834419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.834874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.835032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.835129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.835398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.836025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:13.836322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.836919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.837966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.849635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 787/1573] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:13.850413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.859626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d178c6-6f8d-486b-a72a-1cb276a07e4a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.864181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.864806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.865088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.865351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] PATH_INFO: `/v3/projects/22152a3bdd1543ee8551b9e7fa8935ee/users/21add0b63cbb4192948de08bf4061905/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.874016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 787/1574] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:13.874016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.880150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22152a3bdd1543ee8551b9e7fa8935ee, user_id=21add0b63cbb4192948de08bf4061905, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.881179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:13.881179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:37:13.881179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:37:13.883159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.897704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 788/1575] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:13 2022] PUT /identity/v3/projects/22152a3bdd1543ee8551b9e7fa8935ee/users/21add0b63cbb4192948de08bf4061905/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:13.903065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.937410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90289877-79d6-4f05-90af-87f8aad29358 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.955523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:13.970151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b0f7-bec6-4d5d-a07a-c040dafb3d5e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:13.974759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.975462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.975742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.976009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.976648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.978325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:13.979605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:13.992789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 789/1576] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:13.993944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:13.996058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:13.996662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:13.996935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:13.997258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:13.997925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:13.999565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.004024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae49704-b0a3-439b-9444-da0862920a43 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.008819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.009191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 788/1577] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.009451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.010282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.010499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.010686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.011437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.013723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.023019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f52e-4215-4950-9819-aef0e4b5a24a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.028926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.029525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.029832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.030104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.030727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.032862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.046328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 790/1578] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:13 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.050272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.061934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 789/1579] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.062730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.111305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b241c2-42d9-43ce-ba34-8620b983e738 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.123705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea9c6-5e24-4c81-9b8e-b48dae4b7a54 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.128252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.128839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.129113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.129381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.130024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.131908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.158763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 790/1580] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.162947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.171155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.171763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.172041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.172313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.172943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.174880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c08827-41ab-416d-a43e-18e4747c3d15 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.203501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 791/1581] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.205008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.205336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.205708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.226479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc420a1-bf91-4400-aba9-859cae173542 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.233957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] MFA Rules not processed for user `21add0b63cbb4192948de08bf4061905`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:14.235203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:14.254839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:14.287190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.287908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.288181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.288445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.289115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.291604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.294743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:14.304532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 792/1582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:14.307554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.316081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 791/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.316081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.324722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7603b6-813f-4c08-992b-0a7b6be10958 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.325900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7955c-9836-4f83-a24e-bbef3a045203 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.329639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.330348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.330624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.330748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.330918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] PATH_INFO: `/v3/projects/f78ef0be71154b7bb550f4eabb12955d/users/3f9ca10db40f446bab2330c11df6c792/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.331510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.331850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.332182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] PATH_INFO: `/v3/projects/f9957599b78642099b02d15d5f9ffa0a/users/8714c528b42f4b4c83c4d00dda783612/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.349535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9957599b78642099b02d15d5f9ffa0a, user_id=8714c528b42f4b4c83c4d00dda783612, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.350532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78ef0be71154b7bb550f4eabb12955d, user_id=3f9ca10db40f446bab2330c11df6c792, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.354516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.356644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.369428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 792/1584] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:14 2022] PUT /identity/v3/projects/f9957599b78642099b02d15d5f9ffa0a/users/8714c528b42f4b4c83c4d00dda783612/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:14.370429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.373261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 793/1585] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:14 2022] PUT /identity/v3/projects/f78ef0be71154b7bb550f4eabb12955d/users/3f9ca10db40f446bab2330c11df6c792/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:14.377899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.440292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150519c7-cda6-4768-9961-e29a2699ce37 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.440822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3086511-abe5-41f8-b0bf-5f8a60d90234 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.445070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.445779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.446121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.446457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.447145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.449114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.450640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.452869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.453154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.453433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.454079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.455982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.471495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 794/1586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.472372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.479649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 793/1587] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.480339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.484076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b219d40-a43e-4efb-9e7c-5e55f8b1b540 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.488768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.489354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.489596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe10497-adb9-48aa-85b4-c37664e68679 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.489707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.489923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.490572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.492482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.494308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.494878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.495151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.495413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.496019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.497988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5bccf-ef0e-4e11-8599-ce7ef8a8628b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.514949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 795/1588] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.515951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.522426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 794/1589] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:14.522426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb04b20-b052-4394-bcab-274325df8513 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.522426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb04b20-b052-4394-bcab-274325df8513 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.522426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb04b20-b052-4394-bcab-274325df8513 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.522426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 795/1590] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 15:37:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:14.527492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c41341-67c8-4100-b53f-1896a3ba0355 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.528352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.528734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.529007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.532101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.532946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.533221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.533499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.534157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.535729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1db3f1-7c3d-45ac-bd70-2f64113084df admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.546807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 796/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.547968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.548256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.548456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:14.548585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.549799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:14.557238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 796/1592] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:14.560387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.567354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb6114-4d7a-4ccb-8f55-a05563b5a3ed None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.571821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.572444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.572716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.572980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.573606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.575219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.576333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] MFA Rules not processed for user `3f9ca10db40f446bab2330c11df6c792`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:14.577680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:14.585319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 797/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.589514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.598763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1d1f-62d1-4334-a968-6fd0b24de97c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.603190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.604313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.604587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.604850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.605463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.607068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.616957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 798/1594] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.617967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.627126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2c143-dfc7-4224-928b-ae86acf63888 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.631727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.632388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.632788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.633164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.633906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.635618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce0d5-b5fe-4387-a0d6-2d4f60d3f16f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.642673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 797/1595] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:14.647067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.647175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 799/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.650918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.651604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.651945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.656352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fddc53-45e9-4735-9019-781d902248e8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.661977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.662576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.662851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.663116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.663748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.665327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.682434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 798/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.684383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.697786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a9aca-d489-48eb-91ea-c5f795ab567f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.701138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:14.702385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:14.702887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.703549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.703922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.704279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.704979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.706604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.711381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:14.711897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:14.722638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.722638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.771714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 15:37:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:14.774471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c6be-598d-47bb-bb25-f5b1eb2042a2 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.774949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.778944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.779897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.780189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.780466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.785448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0fb2-6fc0-489e-b92a-6f5e9e9fe061 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.790072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.790243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.790742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.791053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.791322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.791700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.791948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.793520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.801434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 800/1600] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:14.802338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.803559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 801/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.804494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.812038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6834-4a63-4480-a042-20d900e5d987 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.814520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6ee2f-66df-4ce8-8808-5a683bb7609a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.817006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.817599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.817913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.818206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.818816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.819340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.819956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.820234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.820399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0cf3-4230-48c5-91c4-86e1a9ff1e64 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.820510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.821162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.823249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.832755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 801/1602] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.834026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa91-e604-45af-b3d1-facd54f1e1f1 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.834392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa91-e604-45af-b3d1-facd54f1e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.834689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002aa91-e604-45af-b3d1-facd54f1e1f1 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.836204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 802/1603] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 15:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:14.837339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 802/1604] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.838806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.842591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002aa91-e604-45af-b3d1-facd54f1e1f1 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.849364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce9af4-d887-482b-ae3b-9b6d62074583 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.854161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.854826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.855105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.855423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] PATH_INFO: `/v3/projects/a12501fa6db34b788ff67e4c45151ba0/users/c5644c1fa3a94940970e29828bbdf29c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.855974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002aa91-e604-45af-b3d1-facd54f1e1f1 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.861776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.862371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.862647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.862913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.863544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.865559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.871072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12501fa6db34b788ff67e4c45151ba0, user_id=c5644c1fa3a94940970e29828bbdf29c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.874157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:14.878458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 803/1605] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:14.879220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.891848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 803/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:14 2022] PUT /identity/v3/projects/a12501fa6db34b788ff67e4c45151ba0/users/c5644c1fa3a94940970e29828bbdf29c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:14.892807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:14.894817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5f0ae-80e6-453a-bbad-f0c6f4c69374 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.964474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd609e3-d56a-4a34-b0b8-7815afd969a4 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:14.967741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.968567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.968845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.969113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.969492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:14.970177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:14.970468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:14.970718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] PATH_INFO: `/v3/projects/70debc9a37bd4c5cabddbb078adf86f0/users/669bb3546dde473b81b0173b3a897d0b/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:14.987046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70debc9a37bd4c5cabddbb078adf86f0, user_id=669bb3546dde473b81b0173b3a897d0b, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:14.989910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.007957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 804/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:14 2022] PUT /identity/v3/projects/70debc9a37bd4c5cabddbb078adf86f0/users/669bb3546dde473b81b0173b3a897d0b/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:15.007957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.033983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.035583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.046093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 804/1608] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:15.046696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.057299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:15.061043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33801149-16ef-4d0b-b6f0-9555b6b60bc4 service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.084038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:15.092583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7aeac-e550-410d-b0ba-df594316250d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.102771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.104687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.105089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.105431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] PATH_INFO: `/v3/projects/55a2cef47f3745a9a11a56b8e4c48657/users/1ee03ec059984e418638e609ff7ac5bf/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.123234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a2cef47f3745a9a11a56b8e4c48657, user_id=1ee03ec059984e418638e609ff7ac5bf, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.126454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ac3b9-f2dc-40bb-91d8-a49e467afa3a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.156575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 805/1609] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:15 2022] PUT /identity/v3/projects/55a2cef47f3745a9a11a56b8e4c48657/users/1ee03ec059984e418638e609ff7ac5bf/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:15.156575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d8a1-9109-4d8c-8e1b-d75012f47e77 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.156575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d8a1-9109-4d8c-8e1b-d75012f47e77 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.156575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2d8a1-9109-4d8c-8e1b-d75012f47e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.157058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.157058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.157058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.157058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] PATH_INFO: `/v3/projects/ec1fe8646e184969bdca97a32cdbff8a/users/800a5de84659402883c84f39b99b6212/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.174016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1fe8646e184969bdca97a32cdbff8a, user_id=800a5de84659402883c84f39b99b6212, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.174307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1bb2d8a1-9109-4d8c-8e1b-d75012f47e77 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.175797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1bb2d8a1-9109-4d8c-8e1b-d75012f47e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.176757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.193668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 805/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:15 2022] PUT /identity/v3/projects/ec1fe8646e184969bdca97a32cdbff8a/users/800a5de84659402883c84f39b99b6212/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:15.194757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.270613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 806/1611] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.277688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5de2f-ae45-4700-a28e-c48f2b171018 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.280544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568b67d-2d07-49a9-8568-64f2fcc062a7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.280775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568b67d-2d07-49a9-8568-64f2fcc062a7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.281200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568b67d-2d07-49a9-8568-64f2fcc062a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.283532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.284297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.284671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.285193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] PATH_INFO: `/v3/projects/d6e11b0f21324becb5916289dd584c0d/users/da376f7be66d4e0c8467bb4a918a72ab/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.307821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a568b67d-2d07-49a9-8568-64f2fcc062a7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.314015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e11b0f21324becb5916289dd584c0d, user_id=da376f7be66d4e0c8467bb4a918a72ab, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.318022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483e9c6-850d-4e1c-b210-9bbcb3ca4210 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.318405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a568b67d-2d07-49a9-8568-64f2fcc062a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.329792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 807/1612] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.334578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838859a-4a5d-48f6-acdc-a9a7339cb6c0 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.334866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838859a-4a5d-48f6-acdc-a9a7339cb6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.335145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838859a-4a5d-48f6-acdc-a9a7339cb6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.348087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 806/1613] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:15 2022] PUT /identity/v3/projects/d6e11b0f21324becb5916289dd584c0d/users/da376f7be66d4e0c8467bb4a918a72ab/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:15.349432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.349717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.350072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.363530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d838859a-4a5d-48f6-acdc-a9a7339cb6c0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.364855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d838859a-4a5d-48f6-acdc-a9a7339cb6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.386746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] MFA Rules not processed for user `1ee03ec059984e418638e609ff7ac5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.387881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.441778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 808/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.441778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b5d2-ce94-4e87-88e8-487a9912595b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.441778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b5d2-ce94-4e87-88e8-487a9912595b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.441778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0b5d2-ce94-4e87-88e8-487a9912595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.466113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 807/1615] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.467323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.475674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9aa0b5d2-ce94-4e87-88e8-487a9912595b None None] MFA Rules not processed for user `800a5de84659402883c84f39b99b6212`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.476906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9aa0b5d2-ce94-4e87-88e8-487a9912595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.484509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:15.523225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:15.550452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 809/1616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.551724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289e27-6b44-4337-be62-b478bed1a407 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.552090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289e27-6b44-4337-be62-b478bed1a407 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.552362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9289e27-6b44-4337-be62-b478bed1a407 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.553682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 810/1617] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 15:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:15.554459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9289e27-6b44-4337-be62-b478bed1a407 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.559251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e3cf-5c30-490c-a89e-564eb7217f77 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.567165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.568153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.568680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.569030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.616433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9289e27-6b44-4337-be62-b478bed1a407 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.620995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.621782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.622527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.622936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.633709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.635962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.636253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.637959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106e71c-a681-4bde-9d4f-3cb20cfa90c5 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.648999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 808/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:15.650988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.651322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.651670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.667620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 811/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:15.668496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.674619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.675384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.684231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbe6f7-d1a0-4cb5-b8b3-a1acd9acc4ae service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.688779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 809/1620] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.688779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.702866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.703955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.704097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45e0aa-0d8b-4997-a613-70df37b8808a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.704221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.704221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.715884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.716550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.717562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.717750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.718409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.721600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.723141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.724052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49fc0b-b608-4b80-bf8f-a959f26f3cea admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.745430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 812/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:15.746890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.766878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ebcf-b0f6-4a1d-9c0e-936ad46ad1f2 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.773059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 810/1622] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:15.775958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.778167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.778782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.782271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.783141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.783421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.783809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:15.784308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:15.787844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:15.813806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:15.815831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:15.850877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 813/1623] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:15.851774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.937362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 811/1624] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:15.938989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:15.963006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:15.984414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba797a-bce6-4e67-9137-cd8a34d6984e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:15.988264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:15.988871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:15.989146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:15.989413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.032959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d7c3-4ca9-4cdd-b873-bbce5df529a2 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.111966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.113611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.125065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:16.131246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.131246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.132149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.132437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.133095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.136284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.148044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 814/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:16.148992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.169981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ee302-f595-4469-9768-d2c1ccc7a426 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.177080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.177886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.178175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.178449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.179176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.181585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdaa35-955f-4b08-84ac-eed8ede0e034 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.206504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 812/1626] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:15 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:16.208403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.259065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 815/1627] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:16 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:16.263185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d149d-ce0f-41cd-ad5c-96f97d1e7dd3 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.263488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d149d-ce0f-41cd-ad5c-96f97d1e7dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.263770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d149d-ce0f-41cd-ad5c-96f97d1e7dd3 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.265468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 816/1628] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 15:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:16.268942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d149d-ce0f-41cd-ad5c-96f97d1e7dd3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.298586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d149d-ce0f-41cd-ad5c-96f97d1e7dd3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.310591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.311235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.311479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.314301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.316143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.330566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.368602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c16759-0a1f-4bda-a000-14ad6c07b8d8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.369365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 817/1629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:16.370912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.378804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.380690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.380974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.381246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.411007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e86b93-d287-456b-8a32-99d1ab903b4a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.417557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.418285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.418639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.419002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.419724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.421681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26896603-cfcc-49cc-b687-d8bc31babdf3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.445870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 818/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:16.449051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.451359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.452443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.508522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:16.513899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:16.568581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:16.602731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.605196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.631057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 813/1631] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:16.633179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.653710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 819/1632] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:37:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:16.656933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.659380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742503a8-d39b-4293-b02c-558abc0ed630 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.664284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.664958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.665245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.665518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] PATH_INFO: `/v3/projects/b2bbfefc19014fef826a517f3a07e246/users/643ea3e42e0a49498134619c69ff55e3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.701336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dff36-2b10-4ddd-a943-de0161d9ff27 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.715836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bbfefc19014fef826a517f3a07e246, user_id=643ea3e42e0a49498134619c69ff55e3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.720349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.721422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.721868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.722363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] PATH_INFO: `/v3/projects/248da0b6b21c4e4d8910742fbfebce90/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.724881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.753954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 814/1633] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:16 2022] PUT /identity/v3/projects/b2bbfefc19014fef826a517f3a07e246/users/643ea3e42e0a49498134619c69ff55e3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:16.753954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.754712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248da0b6b21c4e4d8910742fbfebce90, user_id=f30f8c3e8b5d4872a9e09ccb6aeff5a9, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.757985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.788183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 820/1634] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:16 2022] PUT /identity/v3/projects/248da0b6b21c4e4d8910742fbfebce90/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:16.788183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.886786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec067c-e46c-40f2-a748-3a6bdbb069f8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.929865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c642-441e-405c-8cb1-0b50349f0631 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.943476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.944117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.944397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.944669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.945359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.947091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:16.966828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 821/1635] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:16.968203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:16.982570 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadae63d-3555-4642-b961-3a76c3996906 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:16.992826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:16.993467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:16.993763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:16.994804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:16.995452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:16.998104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:17.020505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:17.021422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.021838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.022390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:17.032302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 822/1636] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:17.033597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:17.058359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7844a06-c945-4530-ae24-028f328fa5c8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:17.070554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:17.073269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.073557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.075333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] PATH_INFO: `/v3/projects/b2bbfefc19014fef826a517f3a07e246/users/643ea3e42e0a49498134619c69ff55e3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:17.078858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bbfefc19014fef826a517f3a07e246, user_id=643ea3e42e0a49498134619c69ff55e3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:17.084383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:17.093667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:17.122895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 823/1637] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:17 2022] PUT /identity/v3/projects/b2bbfefc19014fef826a517f3a07e246/users/643ea3e42e0a49498134619c69ff55e3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:17.128372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6adcf-4acc-4a73-8536-aff3c747d62f service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 815/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.274826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:17.375658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] MFA Rules not processed for user `643ea3e42e0a49498134619c69ff55e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:17.377198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:17.417357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:17.449776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af9f1c-f021-4b2b-acf0-5d3d67798010 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:17.470737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:17.471530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.471816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.472296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] PATH_INFO: `/v3/projects/248da0b6b21c4e4d8910742fbfebce90/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:17.480040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248da0b6b21c4e4d8910742fbfebce90, user_id=f30f8c3e8b5d4872a9e09ccb6aeff5a9, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:17.487656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122c987-b026-4b72-825a-b3f53d74d7e0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:17.518984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 824/1639] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:17 2022] PUT /identity/v3/projects/248da0b6b21c4e4d8910742fbfebce90/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:17.530749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.531039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.531423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:17.580900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 816/1640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:17.621393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] MFA Rules not processed for user `f30f8c3e8b5d4872a9e09ccb6aeff5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:17.624242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:17.670668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:17.800389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9bdce-47bc-4e99-b0b7-72a0d12bb17b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:17.818062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 825/1641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:17.898618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:17.899242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:17.899495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:17.899766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:18.066646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:18.068700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:18.106506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 817/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:18.238857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:18.255083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ebc7a-b67a-48dc-bfde-4e33259c07a0 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:18.264042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:18.264672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:18.264949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:18.265222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:18.310688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:18.312128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:18.336840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 826/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:18.508736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:18.521811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab08bc-caa7-4b6c-bd27-85b60d3a70e9 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:18.531911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:18.533030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:18.533485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:18.533872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:18.554124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:18.706572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:18.709652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343a081-426e-4c3b-823b-f7fecb7576cd service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:18.736065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 818/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:18.878521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:18.981613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad6ce-0904-4fb3-812e-ce73df7fae0b service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:18.997033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:18.998245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:18.998767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:18.999309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] PATH_INFO: `/v3/users/800a5de84659402883c84f39b99b6212` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:19.000877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800a5de84659402883c84f39b99b6212)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:19.004008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:19.020240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:19.131599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800a5de84659402883c84f39b99b6212'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:19.143744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800a5de84659402883c84f39b99b6212'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:19.144489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800a5de84659402883c84f39b99b6212'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:19.145223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800a5de84659402883c84f39b99b6212'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:19.168209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800a5de84659402883c84f39b99b6212'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:19.194727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:19.195333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 827/1645] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:18 2022] DELETE /identity/v3/users/800a5de84659402883c84f39b99b6212 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:19.195438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:19.195676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:19.238445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:19.239684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:19.371032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 819/1646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:19.386626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:19.388458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:19.505590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff78937-1a77-4857-819a-67bb821482d9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:19.511410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:19.512166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:19.512444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:19.512718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:19.524338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:19.528854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:19.562628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 828/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:21.107929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:21.109406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:21.127684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eed749-887c-4d7c-8220-7a5f0183238a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:21.149005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:21.149588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:21.150884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:21.150884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] PATH_INFO: `/v3/projects/ec1fe8646e184969bdca97a32cdbff8a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:21.154336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1fe8646e184969bdca97a32cdbff8a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:21.156315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:21.266658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1fe8646e184969bdca97a32cdbff8a', 'request_id': 'req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.278129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:21.280160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:21.283592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1fe8646e184969bdca97a32cdbff8a', 'request_id': 'req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.297185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1fe8646e184969bdca97a32cdbff8a', 'request_id': 'req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.304510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d053e7-284b-407a-87dc-641facbc4690 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:21.320057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] The token cache is being invalidate because project ec1fe8646e184969bdca97a32cdbff8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:21.320354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.321497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.324058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 820/1648] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:21 2022] DELETE /identity/v3/projects/ec1fe8646e184969bdca97a32cdbff8a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:21.329763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:21.334317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:21.488021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:21.549466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:21.550220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:21.552887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:21.553172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] PATH_INFO: `/v3/users/21add0b63cbb4192948de08bf4061905` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:21.562395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21add0b63cbb4192948de08bf4061905)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:21.573282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf4c33-1912-4a7e-aaa8-31b75c8a37a2 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:21.576486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:21.601416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:21.602641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:21.603214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:21.605104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] PATH_INFO: `/v3/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:21.607461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30f8c3e8b5d4872a9e09ccb6aeff5a9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:21.610986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: WARNING py.warnings [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:21.610986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: warnings.warn(msg) Sep 12 15:37:21.610986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: Sep 12 15:37:21.613540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:21.678224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:21.777273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21add0b63cbb4192948de08bf4061905'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.790396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30f8c3e8b5d4872a9e09ccb6aeff5a9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.800629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21add0b63cbb4192948de08bf4061905'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.803338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21add0b63cbb4192948de08bf4061905'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.804049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21add0b63cbb4192948de08bf4061905'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.828462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30f8c3e8b5d4872a9e09ccb6aeff5a9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.855163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30f8c3e8b5d4872a9e09ccb6aeff5a9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.856349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30f8c3e8b5d4872a9e09ccb6aeff5a9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.857499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-febe2eea-bbef-421d-8b95-5b39c7bec5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30f8c3e8b5d4872a9e09ccb6aeff5a9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.861459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21add0b63cbb4192948de08bf4061905'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:21.880776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 821/1649] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:21 2022] DELETE /identity/v3/users/f30f8c3e8b5d4872a9e09ccb6aeff5a9 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:21.889388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 829/1650] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:21 2022] DELETE /identity/v3/users/21add0b63cbb4192948de08bf4061905 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:21.896819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:21.897340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:21.898490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:21.930179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:21.932752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:22.044507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 822/1651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:22.191933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:22.193445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:22.325963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92da0e-37a8-4a20-bd2c-ad4783ee7145 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:22.337098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:22.338439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:22.338863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:22.339249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:22.369372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:22.371384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6855c-99a0-4e9a-b5a4-0aab021befb6 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:22.416093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 830/1652] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:23.058521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:23.060336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:23.095687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd7cc6-a503-4103-85bb-a98a7668ba32 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:23.108538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:23.109178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.109455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.109722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] PATH_INFO: `/v3/projects/248da0b6b21c4e4d8910742fbfebce90` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.113941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248da0b6b21c4e4d8910742fbfebce90)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:23.115884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:23.243131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248da0b6b21c4e4d8910742fbfebce90', 'request_id': 'req-40b35795-e2e0-4a19-9d8f-9a5cdff00692'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.266360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:23.293014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248da0b6b21c4e4d8910742fbfebce90', 'request_id': 'req-40b35795-e2e0-4a19-9d8f-9a5cdff00692'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.328842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248da0b6b21c4e4d8910742fbfebce90', 'request_id': 'req-40b35795-e2e0-4a19-9d8f-9a5cdff00692'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.389445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] The token cache is being invalidate because project 248da0b6b21c4e4d8910742fbfebce90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:23.389761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.403477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.413353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 823/1653] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:23 2022] DELETE /identity/v3/projects/248da0b6b21c4e4d8910742fbfebce90 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:23.419675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9ec5-c7f9-4615-b563-82a3290fedee None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.420170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9ec5-c7f9-4615-b563-82a3290fedee None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.421598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9ec5-c7f9-4615-b563-82a3290fedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.485666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2cdd9ec5-c7f9-4615-b563-82a3290fedee None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:23.486963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2cdd9ec5-c7f9-4615-b563-82a3290fedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:23.517076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:23.519253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:23.644165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 831/1654] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:23.655910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.656422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.656849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.690851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:23.690851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:23.711526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 832/1655] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:23.713699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:23.723928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23273-4515-40fd-ab03-b10e96003fac None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:23.729627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:23.730424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.730772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.731153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.732008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:23.732657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:23.735501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b35795-e2e0-4a19-9d8f-9a5cdff00692 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:23.737309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:23.760979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:23.761405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 833/1656] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:23.761631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.761931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.762198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] PATH_INFO: `/v3/projects/22152a3bdd1543ee8551b9e7fa8935ee` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.763570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22152a3bdd1543ee8551b9e7fa8935ee)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:23.765510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:23.766334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:23.779180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac9fb-d4ca-46b8-bc1d-9bc11482dfe3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:23.784940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:23.785931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.786432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.787071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:23.788100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:23.790462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:23.833412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 834/1657] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:23 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:37:23.837894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:23.856401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:23.879966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22152a3bdd1543ee8551b9e7fa8935ee', 'request_id': 'req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.892117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22152a3bdd1543ee8551b9e7fa8935ee', 'request_id': 'req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.922385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22152a3bdd1543ee8551b9e7fa8935ee', 'request_id': 'req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.958433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1c4a-1bd5-466a-b347-63b09f2a21ca admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:23.972126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] The token cache is being invalidate because project 22152a3bdd1543ee8551b9e7fa8935ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:23.972428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.975674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-af11e84f-db8d-46fd-9cf1-d0500c7d15f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:23.980834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 824/1658] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:23 2022] DELETE /identity/v3/projects/22152a3bdd1543ee8551b9e7fa8935ee => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:23.989209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3135a-f357-4e85-9881-3be848901863 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:23.990087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3135a-f357-4e85-9881-3be848901863 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:23.991008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3135a-f357-4e85-9881-3be848901863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.044790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-48b3135a-f357-4e85-9881-3be848901863 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:24.052633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-48b3135a-f357-4e85-9881-3be848901863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:24.084385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.085191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.085580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.089235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.090121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.092503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.155660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 835/1659] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:23 2022] POST /identity/v3/users => generated 303 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:24.158483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.163628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:24.207642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f87d9c-42d5-4c2d-a292-b7f388917e12 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.234791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.235775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.236909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.237348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.238532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.241226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.287805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 825/1660] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:24.290404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.291627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.291918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.307537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 836/1661] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:24.308815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.326500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:24.328047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:24.346710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd00d40-957e-4328-ad90-abb6bee67349 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.362758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.363328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.364918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.365210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.370743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.373657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 826/1662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:24.374987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.375892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.390916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:24.421407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d316a-f411-4145-8ec5-d203ae22d882 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.432690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 837/1663] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:24.434521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.448260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.448881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.449159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.449429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.450185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:24.450488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.452274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.464611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e2c1b-e9cc-49bc-afe3-07bf0fb8db9b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.491638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.494460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 827/1664] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:24.498797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.507839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.508800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.510044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] PATH_INFO: `/v3/projects/2eeceab5e6ad4b1781cbd6b7c2695086/users/e9504531210149e2ab5ed628577ba322/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.530276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e0b6-6b74-4a6a-812a-e8ee681ef3fa admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.553711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.554385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.554662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.554933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.555565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.557531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.583830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2eeceab5e6ad4b1781cbd6b7c2695086, user_id=e9504531210149e2ab5ed628577ba322, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.587115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf21e-f772-463e-a26e-55691a14273f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.632529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 838/1665] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:24 2022] PUT /identity/v3/projects/2eeceab5e6ad4b1781cbd6b7c2695086/users/e9504531210149e2ab5ed628577ba322/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:24.638187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.648329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.652033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.653677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 828/1666] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:24 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:37:24.654619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.690701 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:24.692110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:24.831393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:24.857566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 839/1667] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:24.858741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.860123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:24.879593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb22c-c11d-4ad2-bda7-c9c044195bd8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.886229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012c8d-4b3a-4007-b6e9-12601fd66e73 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:24.897909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.898332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.898442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:24.898685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.899059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:24.899339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:24.899477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.899600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] PATH_INFO: `/v3/users/3f9ca10db40f446bab2330c11df6c792` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:24.900021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.903838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9ca10db40f446bab2330c11df6c792)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:24.905165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.905776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:24.953527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 829/1668] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:24 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:24.955003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:24.959369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.011607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9ca10db40f446bab2330c11df6c792'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:25.030014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9ca10db40f446bab2330c11df6c792'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:25.031113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9ca10db40f446bab2330c11df6c792'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:25.033215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9ca10db40f446bab2330c11df6c792'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:25.060414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9ca10db40f446bab2330c11df6c792'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:25.087494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 840/1669] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:24 2022] DELETE /identity/v3/users/3f9ca10db40f446bab2330c11df6c792 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:25.088481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.090195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.099806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62791d7-a574-4f7c-8eb4-42426457a09b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.180052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.183114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.184733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.184932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.189411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.242538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3f18-f5c7-4c39-85a0-21f34ac71432 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.255564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.256747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.257239 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.257746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.258728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.263161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9def645-9a29-4d10-812a-ea8590f195d2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.267151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:25.291265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 841/1670] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:25.293010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.296304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.296940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.342877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:25.344348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.346903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.348374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.363742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 842/1671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:25.364704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.375227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154228f8-e12f-4aec-8b25-091b289cd1a8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.376259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 830/1672] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:25.380362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.380919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.381200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.381589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.382462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.384074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.395209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.397065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.401475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 843/1673] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:25.402524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.413695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad5cc-d7c1-46cd-9e27-be958ed3a35c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.417817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ba147-8122-4f49-a068-c789c19494cd service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.419598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.420280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.420562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.420835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] PATH_INFO: `/v3/projects/2a8a5cbbf5bd441bbd4d4339bc11e0d3/users/98d92629624f46dcb3675d777bf069d4/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.430268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.431380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.431672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.431947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.440986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8a5cbbf5bd441bbd4d4339bc11e0d3, user_id=98d92629624f46dcb3675d777bf069d4, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.447384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d7e93-494e-4471-aeeb-d2e5f0571243 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.449483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.451114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.475090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 844/1674] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:25 2022] PUT /identity/v3/projects/2a8a5cbbf5bd441bbd4d4339bc11e0d3/users/98d92629624f46dcb3675d777bf069d4/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:25.476359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 831/1675] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:25.487732 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.491983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.493192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.530658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] MFA Rules not processed for user `98d92629624f46dcb3675d777bf069d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:25.533529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:25.549877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:25.698454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.698661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 845/1676] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:25.713946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183d521-e83e-4e92-acd3-cc0643828971 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:25.812033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:25.812812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:25.813184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:25.813553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:25.814751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:25.816820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:25.909707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 832/1677] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:25 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:25.916186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:25.936011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f67c-3a8f-4404-9a09-abc91ddcb266 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:26.107449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:26.109006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.109474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.109977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.110963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:26.113323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:26.153013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 846/1678] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:25 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:26.154737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:26.177346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2bf63-8b88-4fc8-aef5-d8e6e29dcb6d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:26.190140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:26.191450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.193189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.193189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.194205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:26.201247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:26.231046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 833/1679] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:26.235558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:26.258213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5615fd-ea1b-4c67-8ad6-7b1d6b0fad98 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:26.272495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:26.275789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.277255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.277255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] PATH_INFO: `/v3/projects/a242acb3214a4bde97846d32e0600cf1/users/4eba16b3f4824d7988028b524eb4d8d9/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.311261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a242acb3214a4bde97846d32e0600cf1, user_id=4eba16b3f4824d7988028b524eb4d8d9, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:26.314301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:26.374426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 847/1680] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:26 2022] PUT /identity/v3/projects/a242acb3214a4bde97846d32e0600cf1/users/4eba16b3f4824d7988028b524eb4d8d9/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:26.378813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:26.399476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaf971-0480-42f2-884b-426faecd13e4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:26.583618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:26.584298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.584703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.585020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.585837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:26.588221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86547-5d75-40c4-bf41-f77ca136fc56 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:26.602540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 834/1681] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:26.606796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:26.624466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b71796-ea52-40ec-b152-26856cd573a3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:26.636104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:26.637132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.637636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.638145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] PATH_INFO: `/v3/projects/a242acb3214a4bde97846d32e0600cf1/users/4eba16b3f4824d7988028b524eb4d8d9/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.641596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a242acb3214a4bde97846d32e0600cf1, user_id=4eba16b3f4824d7988028b524eb4d8d9, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:26.644811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:26.703389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 848/1682] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:26 2022] PUT /identity/v3/projects/a242acb3214a4bde97846d32e0600cf1/users/4eba16b3f4824d7988028b524eb4d8d9/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:26.705582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:26.705959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:26.706641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:26.785122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] MFA Rules not processed for user `4eba16b3f4824d7988028b524eb4d8d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:26.786443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:26.810391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:26.950035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 835/1683] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:26.962602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:26.964492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:27.066855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aad9d-beb0-457d-b6a0-a7829a74025e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:27.071650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:27.072914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.073197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.073485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.084609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:27.086095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:27.100763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 849/1684] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:27.199845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:27.201251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:27.254428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:27.266208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978db00d-9a36-49c4-a765-fdf4af3a2a1a service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:27.278685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:27.279362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.279478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.280835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.294813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:27.448940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:27.450936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27be772-c9ab-4d1d-ac13-55d1bc71f4b1 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:27.460535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a0712-0df0-4a21-969b-ef4d7818d479 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:27.475071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 850/1685] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:27.476727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ce70-6861-4457-9e9f-25872203cdfb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.477825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ce70-6861-4457-9e9f-25872203cdfb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.478640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:27.479593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.479915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.480518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] PATH_INFO: `/v3/projects/f78ef0be71154b7bb550f4eabb12955d` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.480818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ce70-6861-4457-9e9f-25872203cdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.485019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78ef0be71154b7bb550f4eabb12955d)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:27.487168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:27.572938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8e83ce70-6861-4457-9e9f-25872203cdfb None None] MFA Rules not processed for user `669bb3546dde473b81b0173b3a897d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:27.576340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8e83ce70-6861-4457-9e9f-25872203cdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:27.624066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78ef0be71154b7bb550f4eabb12955d', 'request_id': 'req-c59b9b47-dbe4-4966-be1f-6974ad8d1775'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:27.637040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78ef0be71154b7bb550f4eabb12955d', 'request_id': 'req-c59b9b47-dbe4-4966-be1f-6974ad8d1775'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:27.654366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78ef0be71154b7bb550f4eabb12955d', 'request_id': 'req-c59b9b47-dbe4-4966-be1f-6974ad8d1775'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:27.684055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] The token cache is being invalidate because project f78ef0be71154b7bb550f4eabb12955d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:27.684829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:27.691483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c59b9b47-dbe4-4966-be1f-6974ad8d1775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:27.693780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 836/1686] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:27 2022] DELETE /identity/v3/projects/f78ef0be71154b7bb550f4eabb12955d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:27.702426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ad689-68fa-4b16-838e-23d4476c457a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.702988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ad689-68fa-4b16-838e-23d4476c457a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.704740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ad689-68fa-4b16-838e-23d4476c457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.769147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-cf4ad689-68fa-4b16-838e-23d4476c457a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:27.771529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cf4ad689-68fa-4b16-838e-23d4476c457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:27.816797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 851/1687] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:27.826616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.826896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.828333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:27.896535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:27.911994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] MFA Rules not processed for user `669bb3546dde473b81b0173b3a897d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:27.921695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:27.965510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 837/1688] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:27.970808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:27.976521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:27.977161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.024326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:28.027109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.066228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 838/1689] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:28.066228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.089336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b38c19-014d-41a3-9d72-256c8bb93a44 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.103210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.104801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.106237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.106515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.108729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:28.109055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.115443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 852/1690] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:28.116323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.119877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:28.120666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.149631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 839/1691] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:28.153365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.163938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee88e0-2c5e-4e23-abfc-4992e4bfcd96 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.173873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.184035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.184678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.184961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.185233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] PATH_INFO: `/v3/users/1ee03ec059984e418638e609ff7ac5bf` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.192679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee03ec059984e418638e609ff7ac5bf)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.204441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:28.315831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:28.340942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee03ec059984e418638e609ff7ac5bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:28.358740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee03ec059984e418638e609ff7ac5bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:28.359842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee03ec059984e418638e609ff7ac5bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:28.360835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee03ec059984e418638e609ff7ac5bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:28.368315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2845e-f2d9-454c-bb82-0e0961c50b14 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.394914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.395520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.396010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.396462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.397572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee03ec059984e418638e609ff7ac5bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:28.399137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.430696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.434188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 853/1692] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:28 2022] DELETE /identity/v3/users/1ee03ec059984e418638e609ff7ac5bf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:28.434188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.434398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14388ad-d804-4258-b2dd-33c7a94b03ec service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:28.436062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.459694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 840/1693] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:28.478819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.479474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.479474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.546885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:28.558530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.584600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f8ba4-51f6-47d7-b278-1000d8e3bb66 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.591747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.592274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.592558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.592828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.593620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.595585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:28.662115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 854/1694] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:28 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:28.663216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.715235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 841/1695] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:28.757292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.758809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:28.811555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d67a5-11ec-40d5-9a42-03a67cece76d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.818085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.820044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.821329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.821877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.823004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.826195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:28.864605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:28.913981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd65ce-e73d-41ae-96e5-4d6fb8d90bcb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.927146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 855/1696] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:28 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:28.933628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:28.966485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ae108-cbc4-4bb0-8374-fa75378bb314 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:28.979365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:28.981707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:28.982012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:28.982281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:28.984642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:28.986270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:29.025526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 856/1697] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:29.026866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:29.052148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c722c3e-a34d-4dca-bed9-5fe4113968f3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:29.063005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:29.064954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.065235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.065503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:29.075738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:29.076355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.077347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.080815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:29.081765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:29.085366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:29.092563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:29.096437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af41e2-c0c5-4737-bf73-0dc93314db63 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:29.113762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 857/1698] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:29.114960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:29.124937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 842/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:29.136711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555dee9-b55b-42c5-a561-50a7c6b753f9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:29.149534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:29.150926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.151204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.151475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] PATH_INFO: `/v3/projects/62dc6475bb5148e683f4e9b865b98d42/users/3ea66ce419954cb69a43b14b5f13bbff/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:29.159114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:29.186760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dc6475bb5148e683f4e9b865b98d42, user_id=3ea66ce419954cb69a43b14b5f13bbff, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:29.191438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:29.231764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9366c-ca90-410f-bea1-f3bc484ea3ad None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.231977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9366c-ca90-410f-bea1-f3bc484ea3ad None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.232811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9366c-ca90-410f-bea1-f3bc484ea3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:29.237305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 858/1700] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:29 2022] PUT /identity/v3/projects/62dc6475bb5148e683f4e9b865b98d42/users/3ea66ce419954cb69a43b14b5f13bbff/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:29.277227 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-19f9366c-ca90-410f-bea1-f3bc484ea3ad None None] MFA Rules not processed for user `3ea66ce419954cb69a43b14b5f13bbff`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:29.278646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-19f9366c-ca90-410f-bea1-f3bc484ea3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:29.436245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 843/1701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:29.451655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:29.453766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:29.766040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43461c6e-1f29-4823-a4ca-c80adc54aacb admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:29.791844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:29.803862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.804158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.804439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:29.850568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:29.852734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c339463-679d-425b-a0d3-3d431b656874 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:29.887953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 859/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:29.999368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:29.999958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:29.999958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.073826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c97ee-340b-4a51-bb0e-b8ed531bbcd6 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.074292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c97ee-340b-4a51-bb0e-b8ed531bbcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.074717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c97ee-340b-4a51-bb0e-b8ed531bbcd6 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.076532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 860/1703] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 15:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:30.082730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] MFA Rules not processed for user `e9504531210149e2ab5ed628577ba322`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:30.084198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:30.094632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.095165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.095591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.235626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:30.236785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:30.331054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 844/1704] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:30.332394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:30.400589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 861/1705] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:37:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:30.402398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:30.408047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:30.421491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:30.515020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf898c7-f6e2-4a93-9676-98cb9c2bf021 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:30.532253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a5088-7a65-4f3a-84fb-3321b06fd88c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:30.539047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:30.541264 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.549133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.549518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] PATH_INFO: `/v3/users/3ea66ce419954cb69a43b14b5f13bbff` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.551114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:30.552318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.552755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.553328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.554586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea66ce419954cb69a43b14b5f13bbff)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:30.555330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:30.559132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:30.560691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:30.586883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:30.634085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 862/1706] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:30 2022] POST /identity/v3/projects => generated 405 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:30.637443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:30.675407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea66ce419954cb69a43b14b5f13bbff'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:30.691871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea66ce419954cb69a43b14b5f13bbff'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:30.725321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea66ce419954cb69a43b14b5f13bbff'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:30.734258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea66ce419954cb69a43b14b5f13bbff'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:30.735150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea66ce419954cb69a43b14b5f13bbff'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:30.766761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 845/1707] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:30 2022] DELETE /identity/v3/users/3ea66ce419954cb69a43b14b5f13bbff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:30.768577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:30.772185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:30.795874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6924d1-44ff-49b7-b452-1253dbd156ae admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:30.933004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:30.933678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.934746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9df04-89a8-47c1-b587-dd33a0fa7723 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:30.937831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.938028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.950076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:30.950634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:30.951792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:30.952333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:30.952889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:30.954615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:30.968647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:30.981770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:30.983632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546788f-a3dd-41d7-b4dc-98c2eee3053c service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.009944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 863/1708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:31.009944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.009944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.009944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.049997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 846/1709] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:30 2022] POST /identity/v3/users => generated 309 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:31.051074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.085699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02def835-dd81-4f27-a9c2-b49cfd5c32c8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.099948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:31.101642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.102358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.102734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.103158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.103906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.105765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.106752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.136860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 864/1710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:31.146523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 847/1711] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:31.152769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.180391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d861a3-125d-4a68-b570-ee94bb1ed74d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.196620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.197841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.198798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.199081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] PATH_INFO: `/v3/projects/79cae323e82d41ceb53303123599790b/users/d9465e08fc134276a488138bafc8b1a7/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.206301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.208478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.240139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab017408-3669-4b8c-bbf8-30d05b4025d1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.249582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cae323e82d41ceb53303123599790b, user_id=d9465e08fc134276a488138bafc8b1a7, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.257643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.259136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.260120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.260589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.261396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] PATH_INFO: `/v3/projects/55a2cef47f3745a9a11a56b8e4c48657` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.263930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a2cef47f3745a9a11a56b8e4c48657)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.266092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.297959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 865/1712] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:31 2022] PUT /identity/v3/projects/79cae323e82d41ceb53303123599790b/users/d9465e08fc134276a488138bafc8b1a7/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:37:31.298889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.304295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.361052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:31.466587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a2cef47f3745a9a11a56b8e4c48657', 'request_id': 'req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:31.494720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a2cef47f3745a9a11a56b8e4c48657', 'request_id': 'req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:31.518524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a2cef47f3745a9a11a56b8e4c48657', 'request_id': 'req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:31.538851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abd926-073a-4f09-b4a7-86cc3ae20181 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.565342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] The token cache is being invalidate because project 55a2cef47f3745a9a11a56b8e4c48657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:31.568629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:31.569791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:31.573258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 848/1713] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:31 2022] DELETE /identity/v3/projects/55a2cef47f3745a9a11a56b8e4c48657 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:31.574372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.581748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:31.583265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.609161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.610416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.611410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.611688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.613709 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.696491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.699013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee4d89-1531-4371-a314-e2e4a4eda58c service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.714027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 866/1714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:31.715687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.715984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.716256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.753617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] MFA Rules not processed for user `8714c528b42f4b4c83c4d00dda783612`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:31.755437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.774727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170bd1-ac4f-4933-ba0b-a5e4c4c98061 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.797973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.798951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.800709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.801203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.802120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.803966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.837088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 849/1715] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:31.838285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.842929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:31.857334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 867/1716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:31.857334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.878064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f0b-412d-4dd1-af38-4512afdcb17d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.896081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a838cc-718a-4d4e-871b-be426695cc4e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:31.905647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.906553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.906990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.907555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] PATH_INFO: `/v3/projects/79cae323e82d41ceb53303123599790b/users/d9465e08fc134276a488138bafc8b1a7/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.908600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:31.909405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:31.909931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:31.910350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] PATH_INFO: `/v3/users/643ea3e42e0a49498134619c69ff55e3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:31.914852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cae323e82d41ceb53303123599790b, user_id=d9465e08fc134276a488138bafc8b1a7, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.916274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=643ea3e42e0a49498134619c69ff55e3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:31.919975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.927939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:31.987736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 868/1717] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:31 2022] PUT /identity/v3/projects/79cae323e82d41ceb53303123599790b/users/d9465e08fc134276a488138bafc8b1a7/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:31.992239 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:31.999021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:32.041418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643ea3e42e0a49498134619c69ff55e3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:32.055324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643ea3e42e0a49498134619c69ff55e3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:32.093760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643ea3e42e0a49498134619c69ff55e3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:32.094891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643ea3e42e0a49498134619c69ff55e3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:32.095687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643ea3e42e0a49498134619c69ff55e3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:32.122915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 850/1718] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:31 2022] DELETE /identity/v3/users/643ea3e42e0a49498134619c69ff55e3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:32.252989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:32.316262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62492a1-caf9-4056-b946-cbe10b753ab6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:32.550693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:32.553621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:32.565416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:32.566069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:32.566347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:32.566619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:32.569041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:32.592364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:32.720834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:32.731937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae21c5-066f-47af-af32-5dd92f5e3153 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:32.761687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 869/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:32.876399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee6a3-e099-4469-96ec-fd314383bc6a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:32.876700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee6a3-e099-4469-96ec-fd314383bc6a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:32.876976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bee6a3-e099-4469-96ec-fd314383bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:32.909432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae41-910a-46b4-baa4-f47882870c25 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:32.938290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c6bee6a3-e099-4469-96ec-fd314383bc6a None None] MFA Rules not processed for user `c5644c1fa3a94940970e29828bbdf29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:32.939822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c6bee6a3-e099-4469-96ec-fd314383bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:32.943213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:32.943809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:32.944266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:32.959772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:32.968666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:33.030716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:33.039257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bf98e-d35d-41ea-bcb2-8fb1cb32ccae service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:33.107309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 851/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:33.201182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 870/1721] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:33.204623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:33.205180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:33.205672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:33.225302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:33.225885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:33.226297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:33.285257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] MFA Rules not processed for user `c5644c1fa3a94940970e29828bbdf29c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:33.290350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:33.307526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] MFA Rules not processed for user `669bb3546dde473b81b0173b3a897d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:33.309227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:33.312546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 852/1722] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:33.324933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:33.328000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:33.364214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:33.377382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bebf3-7799-4def-80a7-d3c4c4ece854 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:33.405568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:33.410176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:33.411405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:33.411701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:33.445392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:33.465041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:33.488878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 871/1723] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:33.502650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 853/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:34.841036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:34.842689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:34.894630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:34.896185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:34.975390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869cb05-35f0-43c5-abed-8dbcba0a010f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:34.982596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:34.983248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:34.983526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:34.983795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] PATH_INFO: `/v3/projects/b2bbfefc19014fef826a517f3a07e246` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:34.985074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bbfefc19014fef826a517f3a07e246)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:34.986574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: WARNING py.warnings [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 15:37:34.986574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: warnings.warn(msg) Sep 12 15:37:34.986574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: Sep 12 15:37:34.987926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:35.140547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bbfefc19014fef826a517f3a07e246', 'request_id': 'req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.157532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508153a3-e6cc-4122-9037-20d01ef5098c service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:35.171382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bbfefc19014fef826a517f3a07e246', 'request_id': 'req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.184380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bbfefc19014fef826a517f3a07e246', 'request_id': 'req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.207420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] The token cache is being invalidate because project b2bbfefc19014fef826a517f3a07e246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:35.207420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.208249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-08660db2-aa94-4fc4-84c2-05a66ca8a3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.210177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 872/1725] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:34 2022] DELETE /identity/v3/projects/b2bbfefc19014fef826a517f3a07e246 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:35.214726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8639d-596b-4b92-877d-c34e5e6b7e02 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.215232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8639d-596b-4b92-877d-c34e5e6b7e02 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.215328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8639d-596b-4b92-877d-c34e5e6b7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.262880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3cd8639d-596b-4b92-877d-c34e5e6b7e02 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:35.264116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3cd8639d-596b-4b92-877d-c34e5e6b7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:35.304329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:35.305252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.305420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.305661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] PATH_INFO: `/v3/projects/62dc6475bb5148e683f4e9b865b98d42` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.311571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dc6475bb5148e683f4e9b865b98d42)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:35.314114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:35.376205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:35.378803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:35.403464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dc6475bb5148e683f4e9b865b98d42', 'request_id': 'req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.418106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 873/1726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:35.420241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7206-7a36-4d3e-b14b-d57806a81ade None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.420685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7206-7a36-4d3e-b14b-d57806a81ade None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.421126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b7206-7a36-4d3e-b14b-d57806a81ade None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.422120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dc6475bb5148e683f4e9b865b98d42', 'request_id': 'req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.422892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 874/1727] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 15:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:35.424146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9359-78c7-400f-8550-2410d7dfd9aa None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.424627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9359-78c7-400f-8550-2410d7dfd9aa None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.425161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f9359-78c7-400f-8550-2410d7dfd9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.445151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dc6475bb5148e683f4e9b865b98d42', 'request_id': 'req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.467934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] The token cache is being invalidate because project 62dc6475bb5148e683f4e9b865b98d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:35.468429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.469305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-aa6e00a5-15f3-46f2-8c3a-d1220a28443c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:35.473555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 854/1728] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:34 2022] DELETE /identity/v3/projects/62dc6475bb5148e683f4e9b865b98d42 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:35.478847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-724f9359-78c7-400f-8550-2410d7dfd9aa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:35.480649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-724f9359-78c7-400f-8550-2410d7dfd9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:35.481443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.481885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.483081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.543364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:35.545754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:35.745674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 875/1729] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:35.750301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117edd-ecab-4a56-ac15-8bae5e4eca0b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.752433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117edd-ecab-4a56-ac15-8bae5e4eca0b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.753458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c117edd-ecab-4a56-ac15-8bae5e4eca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.808051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7c117edd-ecab-4a56-ac15-8bae5e4eca0b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:35.809475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7c117edd-ecab-4a56-ac15-8bae5e4eca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:35.815543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 855/1730] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:35.816515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:35.834385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 876/1731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:35.842640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.843274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.843274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.847720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bd93d-d80b-44da-95e3-10d48396d9fd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:35.867514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:35.868329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.870361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.874265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.875277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:35.878548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:35.880749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361a7f6-c1d4-4895-8dfd-9e1f1938d2a0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:35.886314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:35.890593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:35.926061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 877/1732] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:35.930123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:35.954919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dcb24-941b-4f1c-bdc3-a9ed36e813da None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:35.961056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 856/1733] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:35.970761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.971255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:35.971541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.972009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.972127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:35.972917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:35.973574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:35.974467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:35.975049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:35.981039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:36.014633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 878/1734] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:37:36.015684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:36.035764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eba090-f20a-4506-b6a4-41e0af2fe587 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:36.041593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:36.042265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:36.042656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:36.042921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:36.043708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:36.057106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] MFA Rules not processed for user `da376f7be66d4e0c8467bb4a918a72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:36.058338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:36.064762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:36.112620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 879/1735] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:36 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:36.113462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:36.380366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 857/1736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:36.380366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:36.424261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed82d-1c9f-466f-ad9f-8f3c49f43a48 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:36.476614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c381e-c8c3-4875-9796-29d3a853ce50 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:36.503019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:36.504029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:36.504445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:36.504907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:36.513325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:36.524252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:36.619203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:36.643192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 880/1737] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:36 2022] POST /identity/v3/projects => generated 369 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:36.648374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:36.653522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:36.673934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:36.676051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:36.676710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:36.678188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:36.679524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:36.686588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:36.726242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 858/1738] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:36 2022] POST /identity/v3/users => generated 278 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:36.726242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:36.729978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:36.770025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:36.806644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04582d-f521-49c7-beeb-aaa3ef3b6bab admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:36.812056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:36.817763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:36.819707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:36.820210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:36.837829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:36.840362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96606f-6886-4573-ba74-cbd4bb8da622 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:36.865747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 881/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:36.869829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:36.870140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:36.870417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:36.915987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f790e45-7885-48fa-b1a4-47531dcaafff admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:36.977486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] MFA Rules not processed for user `d9465e08fc134276a488138bafc8b1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:36.984097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:37.006813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.007839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.008222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.008597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.171548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 882/1740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:37.171548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.175594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.178409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.214923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 859/1741] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:37.221022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.255258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:37.314759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d82c6-444a-489e-8bca-b31ea44ecbf3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.327581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.351106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.351708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.353402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.354154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.356138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ac4ac-5667-4497-9c1c-4d0f835fd903 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.434345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 883/1742] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:37 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:37.436084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.437562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.438843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.531416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f41c19-f90e-4cca-9e4c-958a01bf7c41 service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.548993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.549622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.550815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.551238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.551897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.556957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.573225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:37.573225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:37.591625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 860/1743] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:37.591625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.629502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:37.647885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367abe67-8819-4d82-a84a-1f5f3b9e2f6b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.685293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.686629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.687924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.690696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.694100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.702471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.758076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 861/1744] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:37.759740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.778726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 884/1745] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:37.779298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.805707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71f41-012f-4598-8a35-90825e588ba5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.813808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bfd3e-56f0-4f31-9bfc-afcb6345ecbe None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.829601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.831114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.831393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.832114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.832326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.834048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.836860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.840055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.841318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.841770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.844258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.848630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.873627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 885/1746] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:37.877442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.882121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 862/1747] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:37.886627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:37.902361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfd20-34cd-4c4d-9fe3-e5b9fb0cb926 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.916906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.918093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.918578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.920412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] PATH_INFO: `/v3/projects/e4942ebdc3e24795b9d8559cbc7d191b/users/fefb2b6a1d264269a39ccd5e5e47d8db/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.925177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162152d-6158-4681-8d4f-ce901e40843d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:37.939195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:37.939876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:37.940151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:37.940422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] PATH_INFO: `/v3/projects/8c6afc79afd84a1cbe28373376248bea/users/783237963cc24055989f87f1c909ee55/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:37.956488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4942ebdc3e24795b9d8559cbc7d191b, user_id=fefb2b6a1d264269a39ccd5e5e47d8db, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.962792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c347f-fe0d-4680-9a6b-48b126841fb0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:37.979306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6afc79afd84a1cbe28373376248bea, user_id=783237963cc24055989f87f1c909ee55, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:37.985764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955c590-3ede-449f-b677-6328d0f048f2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:38.001584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 886/1748] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:37 2022] PUT /identity/v3/projects/e4942ebdc3e24795b9d8559cbc7d191b/users/fefb2b6a1d264269a39ccd5e5e47d8db/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:38.011725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.012100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.012717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:38.021853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 863/1749] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:37 2022] PUT /identity/v3/projects/8c6afc79afd84a1cbe28373376248bea/users/783237963cc24055989f87f1c909ee55/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:38.031197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.031921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.032514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:38.083118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] MFA Rules not processed for user `783237963cc24055989f87f1c909ee55`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:38.086485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:38.107716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] MFA Rules not processed for user `fefb2b6a1d264269a39ccd5e5e47d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:38.108957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:38.245242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 864/1750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:38.245242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:38.250296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:38.354897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 887/1751] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:38.358811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:38.440719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:38.543306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0258f2-002a-476a-ac8e-d23797633825 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:38.550497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:38.552375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.553130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.553660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:38.554601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:38.558791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:38.576206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe78857-4318-44e1-97ea-6b03e539dcfa None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:38.586425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:38.587066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.590012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.590306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:38.640030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 888/1752] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:38 2022] POST /identity/v3/projects => generated 355 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:38.640687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:38.666512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:38.867384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:38.869838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:38.889056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ca7d1-949f-47b4-9c1d-16357503fc1d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:38.900707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 865/1753] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:37:38.901615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:38.907638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:38.908523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.908797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.909080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:38.909682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:38.923302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:38.963052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1c92c-9a65-4f1b-a049-2e217ea437e7 service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:38.995316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:38.996107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:38.996388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:38.996658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.008285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:39.010472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:39.068078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 889/1754] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:38 2022] POST /identity/v3/projects => generated 369 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:39.069772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.104253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 866/1755] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:38 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:39.105132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.145932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2a9cb-ecd5-41ef-ac9c-b2a6d49ba344 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:39.450912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a21e1-f9a2-45dd-9beb-55bcead16126 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:39.484526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:39.485351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:39.485643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:39.485969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.510579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:39.533432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:39.580430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:39.586733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:39.587123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:39.593253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.594045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:39.601712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:39.660916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 890/1756] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:39 2022] POST /identity/v3/users => generated 291 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:39.672610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.683562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 867/1757] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 576 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:39.694848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.711895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958f265-a988-4344-a964-97bea87d7879 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:39.725059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3b551-3641-4671-8464-4537df53723a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:39.738919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:39.741769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:39.742068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:39.742357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.749091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:39.749843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:39.750778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:39.755645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:39.756012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] PATH_INFO: `/v3/projects/1a9b9043b295470a93d4526121bbe6a3/users/c9380b7998354043b24556f2d0ddae95/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.759676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:39.801505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 891/1758] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:39.808670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.817637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b9043b295470a93d4526121bbe6a3, user_id=c9380b7998354043b24556f2d0ddae95, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:39.824418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:39.843748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb45a3-9caf-42b4-b932-dba9a3ad1d28 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:39.870612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:39.871824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:39.874697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 868/1759] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:39 2022] PUT /identity/v3/projects/1a9b9043b295470a93d4526121bbe6a3/users/c9380b7998354043b24556f2d0ddae95/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:39.874834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:39.891961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:39.893670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] PATH_INFO: `/v3/projects/f3d596b8b93948ac9c376afef75f44e6/users/895193cf4aa34ff2a3da57c60fb41f94/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:39.980336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d596b8b93948ac9c376afef75f44e6, user_id=895193cf4aa34ff2a3da57c60fb41f94, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:40.003910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:40.060656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:40.067992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 892/1760] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:39 2022] PUT /identity/v3/projects/f3d596b8b93948ac9c376afef75f44e6/users/895193cf4aa34ff2a3da57c60fb41f94/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:40.070349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:40.194625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08fb8c-e611-4bc1-bc02-30c22da04d4f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:40.277911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:40.364755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173562a-6e7a-4fc8-9953-d50e9408f577 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:40.383545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:40.383764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.384242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.384362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:40.384978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:40.400192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:40.414583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:40.416159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.416831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.422062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:40.424553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:40.427231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:40.446163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 893/1761] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:40.447324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:40.464141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078f6ff-2978-4b67-a60d-e5ea33d314ea admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:40.468989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:40.469660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.469981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.470254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] PATH_INFO: `/v3/projects/f3d596b8b93948ac9c376afef75f44e6/users/895193cf4aa34ff2a3da57c60fb41f94/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:40.473904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d596b8b93948ac9c376afef75f44e6, user_id=895193cf4aa34ff2a3da57c60fb41f94, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:40.478501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf02e1-dd83-48fe-bffd-34fa044f79c3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:40.495194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 869/1762] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 619 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:40.495547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:40.581654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 894/1763] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:40 2022] PUT /identity/v3/projects/f3d596b8b93948ac9c376afef75f44e6/users/895193cf4aa34ff2a3da57c60fb41f94/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:40.583957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca294b-dcb5-455a-a21f-bf8fe428286b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:40.586263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.589614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.589614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:40.675325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] MFA Rules not processed for user `895193cf4aa34ff2a3da57c60fb41f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:40.676884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:40.903793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:40.904836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.905229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.905633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] PATH_INFO: `/v3/projects/1a9b9043b295470a93d4526121bbe6a3/users/c9380b7998354043b24556f2d0ddae95/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:40.908226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b9043b295470a93d4526121bbe6a3, user_id=c9380b7998354043b24556f2d0ddae95, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:40.911324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f72c5-f946-44b7-a54a-a185835e8ac3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:40.926299 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 895/1764] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:40.938084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:40.939830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:40.955483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 870/1765] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:40 2022] PUT /identity/v3/projects/1a9b9043b295470a93d4526121bbe6a3/users/c9380b7998354043b24556f2d0ddae95/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:40.967815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458efe6a-db37-4ff7-969e-999778326c62 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:40.968345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458efe6a-db37-4ff7-969e-999778326c62 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:40.968772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458efe6a-db37-4ff7-969e-999778326c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.102250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-458efe6a-db37-4ff7-969e-999778326c62 None None] MFA Rules not processed for user `c9380b7998354043b24556f2d0ddae95`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:41.106585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-458efe6a-db37-4ff7-969e-999778326c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:41.122981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb23ad-8f34-4a75-8cbe-4f97810db53f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:41.303294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:41.324950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:41.326484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.326484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.326484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.396028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:41.403732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 871/1766] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:41.409056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.410020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.410828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.417848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 872/1767] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:37:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:41.420031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:41.427547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:41.479912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face1a17-64b7-4668-b0fe-7dfd5335f201 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:41.490880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:41.491846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.491981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.492377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.517992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:41.526714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65ee8a-bb14-4cee-8498-9854cf7445bc service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:41.531062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:41.532620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:41.552793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 873/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:41.556647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.557202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.557683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.570867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 896/1769] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:41.631005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:41.632927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:41.816144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:41.826204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24edf1c-e32c-4b87-acc3-194b46aa2682 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:41.831455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:41.832093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.833012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.833397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.837575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 874/1770] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:41.903057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:41.904355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:41.944857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdba71-e175-4b63-a31d-3dc04623ba88 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:41.972397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:41.975238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:41.975611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:41.977352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:41.998346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:42.004064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770591af-2efb-4be0-a2ce-44eef7e26e39 service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:42.018157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:42.038152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:42.048041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 875/1771] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:42.082882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 897/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:44.266188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30aa49-00ef-45fa-91fb-85fb7fc198ac None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:44.267243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30aa49-00ef-45fa-91fb-85fb7fc198ac None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:44.267763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30aa49-00ef-45fa-91fb-85fb7fc198ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:44.305385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6f30aa49-00ef-45fa-91fb-85fb7fc198ac None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:44.307558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6f30aa49-00ef-45fa-91fb-85fb7fc198ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:44.477249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 876/1773] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Sep 12 15:37:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:44.630823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:44.633234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:44.653632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bdf3-11e2-46e3-9857-cdb014bbfa06 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:44.659173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:44.660040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:44.660325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:44.661005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:44.676971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:44.679721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:44.690209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 898/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:45.262223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:45.262542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:45.262781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:45.339231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] MFA Rules not processed for user `8714c528b42f4b4c83c4d00dda783612`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:45.340496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:45.515231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 877/1775] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:45.547112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:45.548764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:45.936945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789919e-fe8e-46f7-8e97-4d76f70617cb service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:45.953349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:45.955566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:45.956175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:45.958045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] PATH_INFO: `/v3/users/e9504531210149e2ab5ed628577ba322` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:45.965506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9504531210149e2ab5ed628577ba322)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:45.971556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:46.126059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9504531210149e2ab5ed628577ba322'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:46.135350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:46.154116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9504531210149e2ab5ed628577ba322'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:46.154943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9504531210149e2ab5ed628577ba322'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:46.156584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9504531210149e2ab5ed628577ba322'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:46.206106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9504531210149e2ab5ed628577ba322'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:46.246230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 899/1776] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:45 2022] DELETE /identity/v3/users/e9504531210149e2ab5ed628577ba322 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:47.538564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:47.568189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f12b97-c4e7-4e35-8666-d5eb7fd28862 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:47.610215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:47.746453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:47.747095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:47.747416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:47.747695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] PATH_INFO: `/v3/users/fefb2b6a1d264269a39ccd5e5e47d8db` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:47.749118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefb2b6a1d264269a39ccd5e5e47d8db)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:47.758898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:47.794066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:47.799677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:47.837368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219b1d1-587d-4462-9c0f-72b729ea6892 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:47.873042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:47.874697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:47.880663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:47.884557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] PATH_INFO: `/v3/projects/2eeceab5e6ad4b1781cbd6b7c2695086` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:47.886295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2eeceab5e6ad4b1781cbd6b7c2695086)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:47.898176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:47.905590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefb2b6a1d264269a39ccd5e5e47d8db'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:47.936508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefb2b6a1d264269a39ccd5e5e47d8db'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:47.983910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefb2b6a1d264269a39ccd5e5e47d8db'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:47.984933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefb2b6a1d264269a39ccd5e5e47d8db'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:47.992335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b7f6dfe-b27e-40b3-846a-cd761fc528cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefb2b6a1d264269a39ccd5e5e47d8db'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.024228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 878/1777] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:47 2022] DELETE /identity/v3/users/fefb2b6a1d264269a39ccd5e5e47d8db => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:48.029378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5054-0e57-453e-9024-f91418961f1c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:48.029913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5054-0e57-453e-9024-f91418961f1c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:48.030397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5054-0e57-453e-9024-f91418961f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:48.073120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2eeceab5e6ad4b1781cbd6b7c2695086', 'request_id': 'req-37c0834c-3c1b-4d90-a728-97ed18cb01dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.100969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-508c5054-0e57-453e-9024-f91418961f1c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:48.106195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-508c5054-0e57-453e-9024-f91418961f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:48.110364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2eeceab5e6ad4b1781cbd6b7c2695086', 'request_id': 'req-37c0834c-3c1b-4d90-a728-97ed18cb01dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.133457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2eeceab5e6ad4b1781cbd6b7c2695086', 'request_id': 'req-37c0834c-3c1b-4d90-a728-97ed18cb01dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.196392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] The token cache is being invalidate because project 2eeceab5e6ad4b1781cbd6b7c2695086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:48.197231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.198693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.205002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 900/1778] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:47 2022] DELETE /identity/v3/projects/2eeceab5e6ad4b1781cbd6b7c2695086 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:37:48.210969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:48.216939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:48.341526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 879/1779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:48.411701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5054-0e57-453e-9024-f91418961f1c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:48.414743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-508c5054-0e57-453e-9024-f91418961f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:48.552891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0834c-3c1b-4d90-a728-97ed18cb01dd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:48.566153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:48.579280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:48.580620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:48.580855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:48.582530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] PATH_INFO: `/v3/users/d9465e08fc134276a488138bafc8b1a7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:48.588488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9465e08fc134276a488138bafc8b1a7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:48.590562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:48.613995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5054-0e57-453e-9024-f91418961f1c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:48.622613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:48.623629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:48.625502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:48.626034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:48.659267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:48.661523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e644-6dfa-4bdc-812b-1dcd2ed22e74 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:48.699764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 880/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:48.744848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9465e08fc134276a488138bafc8b1a7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.749668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:48.764426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9465e08fc134276a488138bafc8b1a7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.767353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9465e08fc134276a488138bafc8b1a7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.769178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9465e08fc134276a488138bafc8b1a7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.791268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7e12da37-1f32-437a-aa2f-f5f6e3acd7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9465e08fc134276a488138bafc8b1a7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:48.857747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 901/1781] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:48 2022] DELETE /identity/v3/users/d9465e08fc134276a488138bafc8b1a7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:51.052801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:51.053350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:51.053553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:51.116267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] MFA Rules not processed for user `da376f7be66d4e0c8467bb4a918a72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:51.133134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:51.346942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a308-7e9c-4b1b-9e81-9f124860905c None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:51.348104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a308-7e9c-4b1b-9e81-9f124860905c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:51.348603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89a308-7e9c-4b1b-9e81-9f124860905c None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:51.350623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 902/1782] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:37:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:51.363569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f86ef-4b14-495b-854f-32fe3991baf9 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:51.364032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f86ef-4b14-495b-854f-32fe3991baf9 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:51.364549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f86ef-4b14-495b-854f-32fe3991baf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:51.411151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e04f86ef-4b14-495b-854f-32fe3991baf9 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:51.411709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 881/1783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:51.413313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e04f86ef-4b14-495b-854f-32fe3991baf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:51.609002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 903/1784] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:51.891516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:51.893032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.078004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e9570-fc03-4b54-9360-0ae885e91d25 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.078417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e9570-fc03-4b54-9360-0ae885e91d25 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.078554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e9570-fc03-4b54-9360-0ae885e91d25 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.080064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 904/1785] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:37:52.093999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2c44c-4fdf-4e22-888d-f0053b209e77 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.101125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.101800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.102086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.113946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] PATH_INFO: `/v3/projects/79cae323e82d41ceb53303123599790b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.115346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cae323e82d41ceb53303123599790b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.117500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.153088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.153513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.154113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.201827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:52.203688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.239418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 905/1786] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:52.242897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:52.245539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.277636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cae323e82d41ceb53303123599790b', 'request_id': 'req-97c67ac7-b1b8-4e89-9246-ad9372bab410'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.279199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacb181-b8e6-48dd-b8a8-c8f8e3c6d979 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.292551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cae323e82d41ceb53303123599790b', 'request_id': 'req-97c67ac7-b1b8-4e89-9246-ad9372bab410'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.300471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cae323e82d41ceb53303123599790b', 'request_id': 'req-97c67ac7-b1b8-4e89-9246-ad9372bab410'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.325847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] The token cache is being invalidate because project 79cae323e82d41ceb53303123599790b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:52.326166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.327417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-97c67ac7-b1b8-4e89-9246-ad9372bab410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.328963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 882/1787] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:51 2022] DELETE /identity/v3/projects/79cae323e82d41ceb53303123599790b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:52.334406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.334600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.334834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.377587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:52.380594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.394241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:52.437392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.438562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.438855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.439161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] PATH_INFO: `/v3/projects/e4942ebdc3e24795b9d8559cbc7d191b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.441389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4942ebdc3e24795b9d8559cbc7d191b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.451426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.510203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 883/1788] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:52.511070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:52.512768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.585746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4942ebdc3e24795b9d8559cbc7d191b', 'request_id': 'req-667b8698-aa23-4664-a7b6-fe3b403a93aa'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.600443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4942ebdc3e24795b9d8559cbc7d191b', 'request_id': 'req-667b8698-aa23-4664-a7b6-fe3b403a93aa'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.610917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:52.623923 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4942ebdc3e24795b9d8559cbc7d191b', 'request_id': 'req-667b8698-aa23-4664-a7b6-fe3b403a93aa'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.655456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] The token cache is being invalidate because project e4942ebdc3e24795b9d8559cbc7d191b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:52.657172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.659343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-667b8698-aa23-4664-a7b6-fe3b403a93aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.669001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 906/1789] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:52 2022] DELETE /identity/v3/projects/e4942ebdc3e24795b9d8559cbc7d191b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:52.670464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.674010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.674304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.692653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba4033-1d1b-40db-9b09-6f74130255c8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.721491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:52.723219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.824972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.826350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.827894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.827894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.832283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 907/1790] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:52.832283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:52.832283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.833439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:52.848912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.850255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f66ce-d04b-4fe1-b988-85552cf31e34 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.851132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.859003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.860551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.861009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.861247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] PATH_INFO: `/v3/users/895193cf4aa34ff2a3da57c60fb41f94` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.869130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895193cf4aa34ff2a3da57c60fb41f94)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.869130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.872980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 884/1791] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:52.873999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:52.891215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec6914-c429-4ed9-bd83-5d977051b0fc service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.898822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.900645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.901093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.901632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.902635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:52.903487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.906489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.924310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 885/1792] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:52.928858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:52.941724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca160a7-8ec5-4590-aa7c-202156cd4cb8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:52.951671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:52.952293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:52.952571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:52.952856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:52.953493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:52.955589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:52.971404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895193cf4aa34ff2a3da57c60fb41f94'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.986036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895193cf4aa34ff2a3da57c60fb41f94'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.986990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895193cf4aa34ff2a3da57c60fb41f94'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.987769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895193cf4aa34ff2a3da57c60fb41f94'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:52.988801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:53.004178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 886/1793] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:52 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:53.005838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.008560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:53.017720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895193cf4aa34ff2a3da57c60fb41f94'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.067653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 908/1794] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:52 2022] DELETE /identity/v3/users/895193cf4aa34ff2a3da57c60fb41f94 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:53.080690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.082225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:53.132420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431154-ed56-4ce7-a6e3-59046a3ce458 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.175233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:53.219514 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61800694-b8f3-4195-a176-1a2f8fdf1f06 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.241122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.241356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.241719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.242022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.242131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.242281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.242567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.242890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.244431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.247472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.251782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:53.284537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.289430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.295502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 887/1795] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:53 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:53.297945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.316116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 909/1796] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:53.319192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496a306-4d9d-4bb5-bd15-dc8da1a466eb admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.332667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.333288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.333565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.333860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.335052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.340003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.355883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 888/1797] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:37:53.360349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.374393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dcb48-3269-478a-84c0-b6288eb54a04 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.419018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.421896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.421896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.425128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.426359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.431469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052ae10-3337-4e62-b97b-f3305f682a39 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.461116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 910/1798] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:53.462964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.473895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c151fa6-c94e-4de0-a112-d3a9e768fd0c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.491205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.491885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.492169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.492446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] PATH_INFO: `/v3/projects/feccdc0134aa40649746e5402c430f9c/users/4adc0b84d51649c082478c0e03cbbf23/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.543326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feccdc0134aa40649746e5402c430f9c, user_id=4adc0b84d51649c082478c0e03cbbf23, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.547379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.577913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 889/1799] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:53 2022] PUT /identity/v3/projects/feccdc0134aa40649746e5402c430f9c/users/4adc0b84d51649c082478c0e03cbbf23/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:53.600004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.600500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.600979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.649131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] MFA Rules not processed for user `4adc0b84d51649c082478c0e03cbbf23`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:53.651325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:53.744357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.750744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:53.750879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 911/1800] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:53.751721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.831773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98e547-4803-4c65-a463-f42a64bf81af None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.840426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.841542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.842464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.843000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.843807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.847293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.872108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d19111-ee9f-4c73-bc8d-f18b63776405 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:53.882037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:53.882896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.883175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.883446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] PATH_INFO: `/v3/projects/f3d596b8b93948ac9c376afef75f44e6` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.885095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d596b8b93948ac9c376afef75f44e6)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:53.887021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:53.888663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:53.906206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 912/1801] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:53 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:53.913901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:53.946046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d596b8b93948ac9c376afef75f44e6', 'request_id': 'req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.955689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d596b8b93948ac9c376afef75f44e6', 'request_id': 'req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.963881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d596b8b93948ac9c376afef75f44e6', 'request_id': 'req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.964807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:53.978277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] The token cache is being invalidate because project f3d596b8b93948ac9c376afef75f44e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:53.978643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.979216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0356c95f-c17f-477c-8c1e-f2ea53d4f0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:53.980770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 890/1802] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:53 2022] DELETE /identity/v3/projects/f3d596b8b93948ac9c376afef75f44e6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:53.985634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2968-54c4-4c0b-97d7-6f9d4f2977ef None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:53.986011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2968-54c4-4c0b-97d7-6f9d4f2977ef None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:53.986274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb2968-54c4-4c0b-97d7-6f9d4f2977ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:53.987815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f025a-d9ff-4670-b61e-2cc1a76da83f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.007288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2abb2968-54c4-4c0b-97d7-6f9d4f2977ef None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:54.009664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2abb2968-54c4-4c0b-97d7-6f9d4f2977ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:54.062840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.063457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.063734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.064061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.064712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.066680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.084925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 891/1803] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:54.093955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.094427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.094844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.097763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 913/1804] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:53 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:37:54.101549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.103407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:54.115743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b949f-bb65-4499-a2af-2892010017ca admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.120590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:54.121746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:54.121874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.122398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.122720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.123074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.123574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.125274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.135686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 892/1805] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:54.136329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 914/1806] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:37:54.136711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.140193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.146709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a86cf-e915-4088-bf2e-1f0c8834d588 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.150867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda36b4-f9e9-4761-8a14-9b0b8e3f0ec4 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.151809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.152410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.152686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.152955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.153769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:54.154071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.155484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.155932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.156122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.156452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.156673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] PATH_INFO: `/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7/users/552d504874ef4ca79d6de281b117d065/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.170386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 893/1807] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:37:54.174364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1c9b9db3ac416b8b011a30882b27c7, user_id=552d504874ef4ca79d6de281b117d065, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.174607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.177176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.186305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9fb7d-778a-41bd-a876-1c8889deb9bd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.192475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.193076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.193350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.193619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.194281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.196739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.203246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 915/1808] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:54 2022] PUT /identity/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7/users/552d504874ef4ca79d6de281b117d065/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:37:54.207184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.247613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 894/1809] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:54 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:54.252792 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.303868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d10b2-d686-4b45-932e-1ff6dfd4d252 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.333760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:54.353442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ca3e5-9381-439e-9e25-284d250b9ba1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.359662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.360737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.361019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.361587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.361951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.365290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:54.365535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.378951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.379788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.380091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.380413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.381602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.383448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.404418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 916/1810] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:37:54.405076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 895/1811] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:54 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:54.415478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.415666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.433984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deacb-6c68-43cd-907a-64dce31afa82 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.434510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605eada-a9bc-49b4-a6aa-1964d3b0c811 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.445790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.447277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.447580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.447969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] PATH_INFO: `/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7/users/552d504874ef4ca79d6de281b117d065/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.448951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.449929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.450941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.451691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.452173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1c9b9db3ac416b8b011a30882b27c7, user_id=552d504874ef4ca79d6de281b117d065, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.452674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.454807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.459156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b596d6-6df0-4664-836d-01963aa68fe1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.495036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 917/1812] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:54.496084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.514573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 896/1813] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:54 2022] PUT /identity/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7/users/552d504874ef4ca79d6de281b117d065/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:54.517821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.518152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.518494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.532001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23925e50-21aa-4c56-b442-646bec42b9a8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.577135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] MFA Rules not processed for user `552d504874ef4ca79d6de281b117d065`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:54.578504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:54.707748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.708383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.708661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.708932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.709580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.711341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.724098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 918/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:54.728676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.743580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c613-65cd-45cf-a67b-4268cb3598a2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:54.749403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:54.750317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.750749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.751171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] PATH_INFO: `/v3/projects/119f5e260f1a4598bf29e5cdd8955c0a/users/0162f083431f428882abbe3e5feeebd3/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.778547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119f5e260f1a4598bf29e5cdd8955c0a, user_id=0162f083431f428882abbe3e5feeebd3, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:54.785550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b284e27-f947-4a07-b5cc-c8b3e8d3a713 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:54.800134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 897/1815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:54.815884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:54.816351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 919/1816] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:54 2022] PUT /identity/v3/projects/119f5e260f1a4598bf29e5cdd8955c0a/users/0162f083431f428882abbe3e5feeebd3/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:54.828096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:54.828600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:54.828939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:54.829219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:54.890489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] MFA Rules not processed for user `0162f083431f428882abbe3e5feeebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:54.894160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:55.042513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 920/1817] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:37:55.043946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.050175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae05b45-bca1-4526-9ef2-2e62a46c1d4d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.117136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:55.179726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a877d2-ecab-447a-a305-856b3a1b88a1 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.190177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.191072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.191465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.191942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.192887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.194914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.204564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.208193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.208857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.209887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.264710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 921/1818] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:55 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:55.266879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.280506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:55.384739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.390295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.450008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 898/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:55.459760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879a2b7-08a9-4c08-b0e9-f022bd07bf52 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.471402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.473708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.474369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.475481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.479698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.485382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.554560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 922/1820] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:55 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:55.559114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.578821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e1c3-fa58-4833-9480-5486e1137c2a service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.615550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.617245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.617642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.618150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.618815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.620835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.635899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 899/1821] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:55.640680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.655065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd3c9c-14c6-486c-9175-2f886b114814 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.656541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.657204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.657483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.658323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] PATH_INFO: `/v3/projects/99f9cd121ea144659b3cebad5b604cfa/users/1a0cd3d27ce44cb094baddc9ab584b41/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.676667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f9cd121ea144659b3cebad5b604cfa, user_id=1a0cd3d27ce44cb094baddc9ab584b41, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.679790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.713773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 923/1822] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:55 2022] PUT /identity/v3/projects/99f9cd121ea144659b3cebad5b604cfa/users/1a0cd3d27ce44cb094baddc9ab584b41/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:55.715550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.728610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cbcc6-f75d-4ef5-8ae4-0041ab395128 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.822351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.822945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.823054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.823330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.824109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.825818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57716522-4545-472e-b76a-6ab94bd74c36 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.846044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 900/1823] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:55.850512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:55.867184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076d36-c55c-486a-a242-51d439a7e20e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:55.874727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:55.875773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.876132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.876801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] PATH_INFO: `/v3/projects/99f9cd121ea144659b3cebad5b604cfa/users/1a0cd3d27ce44cb094baddc9ab584b41/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.879840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f9cd121ea144659b3cebad5b604cfa, user_id=1a0cd3d27ce44cb094baddc9ab584b41, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:55.884965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:55.903712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 924/1824] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:55 2022] PUT /identity/v3/projects/99f9cd121ea144659b3cebad5b604cfa/users/1a0cd3d27ce44cb094baddc9ab584b41/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:37:55.914311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:55.914654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:55.915444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:55.980327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] MFA Rules not processed for user `1a0cd3d27ce44cb094baddc9ab584b41`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:55.986060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:56.033250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.118713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 901/1825] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:56.131893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.144837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ff12-de49-4f31-be8e-0137041abaf0 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.152416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '552d504874ef4ca79d6de281b117d065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1c9b9db3ac416b8b011a30882b27c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.153272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.153972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.154381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.155332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:56.155901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.158803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.177195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:56.181160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 925/1826] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:37:56.185816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.198843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e545f95-ecaa-4e0b-a88d-1dbe7d43fbab tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.203794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '552d504874ef4ca79d6de281b117d065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1c9b9db3ac416b8b011a30882b27c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.204519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.204803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.205078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.205888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.207837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.213178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7234d0-d96c-4725-8236-89f4a0eac3c1 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.217775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.218628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.219018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.219242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.221475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:56.242491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.244020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.247457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 926/1827] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:56 2022] POST /identity/v3/projects => generated 354 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:37:56.253001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.271437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 902/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:56.336204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.340259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:56.344597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b3003-454a-40f3-bef7-188dc842f2e8 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.349686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '552d504874ef4ca79d6de281b117d065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1c9b9db3ac416b8b011a30882b27c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.350325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.350608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.350883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.351529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:56.351832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.353762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.353882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b44dd-c911-4cd9-8d9b-6ab011a48057 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.367318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 927/1829] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:56.437917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.460509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4799bb-80ca-46ec-a241-f19f98272bf4 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:56.469301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '552d504874ef4ca79d6de281b117d065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f1c9b9db3ac416b8b011a30882b27c7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.470970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.471478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.471762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] PATH_INFO: `/v3/projects/eb9b5665601944068fb92de68d3a5528` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.472928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb9b5665601944068fb92de68d3a5528)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.474896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.504119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:56.505008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:56.505501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:56.506008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:56.553627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9b5665601944068fb92de68d3a5528', 'request_id': 'req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:56.562678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9b5665601944068fb92de68d3a5528', 'request_id': 'req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:56.579822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9b5665601944068fb92de68d3a5528', 'request_id': 'req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:56.592521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] The token cache is being invalidate because project eb9b5665601944068fb92de68d3a5528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:56.592825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:56.593509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:56.598789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 928/1830] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:56 2022] DELETE /identity/v3/projects/eb9b5665601944068fb92de68d3a5528 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:56.603880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:56.605440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90812d-7ffa-4892-bc2a-800c87492cfd service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:56.616114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 903/1831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:37:56.971984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:56.973592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:57.053978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c627d9-58f7-4a91-a2b2-fb92dfbf7174 tempest-VolumeQuotaClassesTest-1777498675 tempest-VolumeQuotaClassesTest-1777498675-project-admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:57.059225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:57.059847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:57.060126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:57.060397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] PATH_INFO: `/v3/users/4adc0b84d51649c082478c0e03cbbf23` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:57.061589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adc0b84d51649c082478c0e03cbbf23)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:57.063626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:57.069509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:57.112815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adc0b84d51649c082478c0e03cbbf23'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.119666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adc0b84d51649c082478c0e03cbbf23'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.120377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adc0b84d51649c082478c0e03cbbf23'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.121011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adc0b84d51649c082478c0e03cbbf23'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.134051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adc0b84d51649c082478c0e03cbbf23'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.147016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 929/1832] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:56 2022] DELETE /identity/v3/users/4adc0b84d51649c082478c0e03cbbf23 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:57.151822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:57.152108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:57.152384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:57.173942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:57.175165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:57.247128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 904/1833] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:57.258046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:57.259471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:57.318147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6039833-3877-4d52-85f9-83cfd370603f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:57.321695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:57.322321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:57.322597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:57.325117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:57.332450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:57.333916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:57.344270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 930/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:37:57.633709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:57.635291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:57.648473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c439680-5c1f-4430-8775-ad353a5149e3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:57.656171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:57.656818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:57.657127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:57.657361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] PATH_INFO: `/v3/projects/feccdc0134aa40649746e5402c430f9c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:57.659265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feccdc0134aa40649746e5402c430f9c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:57.661473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:57.700484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:57.747304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feccdc0134aa40649746e5402c430f9c', 'request_id': 'req-a555bd3d-844b-45af-ba83-5653897b7c74'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.756226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feccdc0134aa40649746e5402c430f9c', 'request_id': 'req-a555bd3d-844b-45af-ba83-5653897b7c74'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.766554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feccdc0134aa40649746e5402c430f9c', 'request_id': 'req-a555bd3d-844b-45af-ba83-5653897b7c74'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.784179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] The token cache is being invalidate because project feccdc0134aa40649746e5402c430f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:57.784469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.785266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:57.786992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 905/1835] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:57 2022] DELETE /identity/v3/projects/feccdc0134aa40649746e5402c430f9c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:57.791379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:57.802468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71501-fdb9-4e04-a37e-b2493dfd51c8 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:57.920165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:57.921286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:57.922051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:57.922883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] PATH_INFO: `/v3/users/552d504874ef4ca79d6de281b117d065` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:57.924346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] RBAC: Authorizing `identity:delete_user(user_id=552d504874ef4ca79d6de281b117d065)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:57.928004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:57.986786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:58.020892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552d504874ef4ca79d6de281b117d065'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:58.038368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552d504874ef4ca79d6de281b117d065'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:58.042313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552d504874ef4ca79d6de281b117d065'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:58.043655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552d504874ef4ca79d6de281b117d065'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:58.109558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bdd4352c-8f82-4c2e-a307-6ef9b647595d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552d504874ef4ca79d6de281b117d065'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:58.134160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 931/1836] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:37:57 2022] DELETE /identity/v3/users/552d504874ef4ca79d6de281b117d065 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:59.169484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.175346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:59.204523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555bd3d-844b-45af-ba83-5653897b7c74 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.263199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.263829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.264108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.264688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] PATH_INFO: `/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.265518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1c9b9db3ac416b8b011a30882b27c7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.267442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.320855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1c9b9db3ac416b8b011a30882b27c7', 'request_id': 'req-c03e02b3-7faf-4e1a-a68f-73f641444884'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:59.330776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1c9b9db3ac416b8b011a30882b27c7', 'request_id': 'req-c03e02b3-7faf-4e1a-a68f-73f641444884'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:59.339832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1c9b9db3ac416b8b011a30882b27c7', 'request_id': 'req-c03e02b3-7faf-4e1a-a68f-73f641444884'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:59.353180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] The token cache is being invalidate because project 8f1c9b9db3ac416b8b011a30882b27c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:37:59.353616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:59.354517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c03e02b3-7faf-4e1a-a68f-73f641444884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:37:59.361775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 906/1837] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:37:59 2022] DELETE /identity/v3/projects/8f1c9b9db3ac416b8b011a30882b27c7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:59.364213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.365054 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.365522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.391872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:59.394070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:59.459648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 932/1838] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:59.467272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.467522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.467825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.488057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:59.489243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:59.497190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 907/1839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:37:59.501462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.511289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb468e-a21a-4940-942e-98a3c4e15410 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.519152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.519941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.520287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.520620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.521327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:37:59.521642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.523342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.535913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 933/1840] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:37:59.540841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.550185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfcfa3-dd6b-4ec8-81db-9a794c3b876b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.554757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.555470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.555754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.556026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.556928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.558998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.594234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 908/1841] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:37:59 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:59.595394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.607076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c30d8-a9b4-4d2f-9cb7-6fb4e31b9c64 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.678607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.679220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.679499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.679768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.680434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.682399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.714960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 934/1842] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:37:59 2022] POST /identity/v3/users => generated 305 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:37:59.719051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.729652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb78d96-729f-471e-9408-0ceaa48eb92b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.734699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.735310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.735573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.735841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.736481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.738119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.740330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:59.754779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 909/1843] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:37:59.755206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.766071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347e1d4-bd45-4252-93bb-1e9142c1d352 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.770912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.771512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.771793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.772063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.772725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.778387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59750b6-0323-4345-95ba-3bb7431d0e7a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.790168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 935/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:37:59.794834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:37:59.806945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ee15-b17c-48a7-8220-732cde04eeb1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:37:59.812125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:37:59.812782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.813074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.813341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] PATH_INFO: `/v3/projects/b41cdf243e5b4010b8088fffeb36f9b5/users/4aea76dc91e0450388634c2370646c74/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.841650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41cdf243e5b4010b8088fffeb36f9b5, user_id=4aea76dc91e0450388634c2370646c74, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:37:59.845088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:37:59.860769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 910/1845] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:37:59 2022] PUT /identity/v3/projects/b41cdf243e5b4010b8088fffeb36f9b5/users/4aea76dc91e0450388634c2370646c74/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:37:59.871172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:37:59.871646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:37:59.872008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:37:59.908430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:37:59.911850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] MFA Rules not processed for user `4aea76dc91e0450388634c2370646c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:37:59.913498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:37:59.999203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 936/1846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:37:59 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:00.004421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.075789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7d7b-7e54-41eb-b50d-fa673defa1c4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.080670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.081411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.081684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.081982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.083085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.085114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.123148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 911/1847] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:00 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:00.127277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.140071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a598f-b054-4aed-9bb7-95b42b513b0d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.212928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.213777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.214191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.214560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.215516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.218106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.258484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 937/1848] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:00 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:00.263302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.279473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3fe7f-837c-4bae-967f-a41364503908 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.288400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.289028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.292734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.293053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.293945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.299088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.323857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 912/1849] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:00.328058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.344437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835bafd-05d9-4999-a8ac-90cd327b55c3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.357386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.359840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.360150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.360439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] PATH_INFO: `/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042/users/80244054079d46da9633f56d2d65040f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.402914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0bee9a8df24d8288bc942b6f8ce042, user_id=80244054079d46da9633f56d2d65040f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.406036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.433450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 938/1850] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:00 2022] PUT /identity/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042/users/80244054079d46da9633f56d2d65040f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:00.434722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.453215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11fb1c-e047-4230-ba32-1ff26e4d3321 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.548298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.549116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.549510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.549907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.550853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.553036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.562104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.564702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:00.564901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 913/1851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:00.569092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.580605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19263329-1fdd-4b98-98fb-a2a524823d58 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.587516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.588511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.588892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.589259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] PATH_INFO: `/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042/users/80244054079d46da9633f56d2d65040f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.591612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0bee9a8df24d8288bc942b6f8ce042, user_id=80244054079d46da9633f56d2d65040f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.596195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72d31b-0196-414c-8f88-681e63fab722 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.598084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe22786-5d49-4912-a87b-213441b565f7 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.618517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:00.622885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 914/1852] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:00 2022] PUT /identity/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042/users/80244054079d46da9633f56d2d65040f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:00.634659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.635238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.635603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.638668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.639582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.639889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] PATH_INFO: `/v3/users/0162f083431f428882abbe3e5feeebd3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.645977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0162f083431f428882abbe3e5feeebd3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:00.653438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:00.696614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] MFA Rules not processed for user `80244054079d46da9633f56d2d65040f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:00.698082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:00.740974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:00.799866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0162f083431f428882abbe3e5feeebd3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:00.843521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0162f083431f428882abbe3e5feeebd3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:00.844294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0162f083431f428882abbe3e5feeebd3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:00.844807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0162f083431f428882abbe3e5feeebd3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:00.853370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:00.855080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 915/1853] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:00.863714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f5156ee4-48e5-4091-8a07-7c80ea242c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0162f083431f428882abbe3e5feeebd3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:00.874724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.876171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:00.879479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 939/1854] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:00 2022] DELETE /identity/v3/users/0162f083431f428882abbe3e5feeebd3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:00.885045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:00.885675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:00.886186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:00.908779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:00.910150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:00.940752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770219bc-68b5-47f4-8b34-9ee0eefdc0b7 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:00.982948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 940/1855] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:00.997476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:00.999146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.011748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.012619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.013878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.014902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.020712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.079682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ec24-4ebf-4fc6-aefd-6ec90631f336 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.083312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.083914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.084186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.084454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.095613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.097505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.099036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.100470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.112105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 941/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:01.115909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 916/1857] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:00 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:01.333610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:01.334926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.342529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:01.344921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.351263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264d04-11be-4568-b6b4-dacd3308aa08 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.356303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.356936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.357225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.357482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] PATH_INFO: `/v3/users/783237963cc24055989f87f1c909ee55` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.358857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] RBAC: Authorizing `identity:delete_user(user_id=783237963cc24055989f87f1c909ee55)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.359656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51d9dd-91a6-439f-b675-5a8b405a7691 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.361372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.364506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.365594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.365594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.366314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.370076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.394772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:01.434813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783237963cc24055989f87f1c909ee55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.448583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783237963cc24055989f87f1c909ee55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.449556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783237963cc24055989f87f1c909ee55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.450694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783237963cc24055989f87f1c909ee55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.465748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.467215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.480150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 917/1858] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:01.481134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:01.482986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.485035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d1519efb-9472-4823-b048-b0f41f25353f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783237963cc24055989f87f1c909ee55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.491431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:01.504332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 942/1859] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:01 2022] DELETE /identity/v3/users/783237963cc24055989f87f1c909ee55 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:01.508195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a2e1-873b-4a81-b36b-73f89cb22c35 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.508853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.509437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.509762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.535265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:01.536590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.582141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.582883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.583234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.583759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] PATH_INFO: `/v3/projects/119f5e260f1a4598bf29e5cdd8955c0a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.585051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119f5e260f1a4598bf29e5cdd8955c0a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.589263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.616467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 943/1860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:01.643084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:01.645021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.656527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119f5e260f1a4598bf29e5cdd8955c0a', 'request_id': 'req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.665571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119f5e260f1a4598bf29e5cdd8955c0a', 'request_id': 'req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.673562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119f5e260f1a4598bf29e5cdd8955c0a', 'request_id': 'req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.687965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] The token cache is being invalidate because project 119f5e260f1a4598bf29e5cdd8955c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:01.688431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.689111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.690857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 918/1861] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:01 2022] DELETE /identity/v3/projects/119f5e260f1a4598bf29e5cdd8955c0a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:01.703111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:01.705169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.725032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5828455-84d0-4efd-8ba8-44cfac06cda2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.774261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:01.793673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.794587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.794985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.795257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.798214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c7778-6a86-45bb-b33b-ce4ad7d247e7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:01.804845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:01.806544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:01.808291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:01.808654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] PATH_INFO: `/v3/users/1a0cd3d27ce44cb094baddc9ab584b41` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:01.810881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0cd3d27ce44cb094baddc9ab584b41)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.814828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:01.818621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.843592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:01.845003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:01.869638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 944/1862] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:01.954601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0cd3d27ce44cb094baddc9ab584b41'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:01.963247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0cd3d27ce44cb094baddc9ab584b41'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.016510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0cd3d27ce44cb094baddc9ab584b41'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.017283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0cd3d27ce44cb094baddc9ab584b41'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.017947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0cd3d27ce44cb094baddc9ab584b41'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.049100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 919/1863] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:01 2022] DELETE /identity/v3/users/1a0cd3d27ce44cb094baddc9ab584b41 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:02.422135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.433609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.435694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:02.451052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bba5f-4de2-495d-b063-c5425c0f0a3a service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.506678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:02.514971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27531-9cb0-4812-8810-5fc3e6feece6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.515143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:02.515798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.516245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.516524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] PATH_INFO: `/v3/projects/99f9cd121ea144659b3cebad5b604cfa` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.517623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f9cd121ea144659b3cebad5b604cfa)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:02.519617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:02.519828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:02.520516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.520881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.521317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] PATH_INFO: `/v3/projects/8c6afc79afd84a1cbe28373376248bea` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.522516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6afc79afd84a1cbe28373376248bea)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:02.525075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:02.566811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f9cd121ea144659b3cebad5b604cfa', 'request_id': 'req-a5e54199-b6fe-4088-9b84-befaad945697'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.571577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6afc79afd84a1cbe28373376248bea', 'request_id': 'req-1fc2cf58-d9c7-411c-9a52-18fba473b543'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.572865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f9cd121ea144659b3cebad5b604cfa', 'request_id': 'req-a5e54199-b6fe-4088-9b84-befaad945697'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.579713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6afc79afd84a1cbe28373376248bea', 'request_id': 'req-1fc2cf58-d9c7-411c-9a52-18fba473b543'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.582803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f9cd121ea144659b3cebad5b604cfa', 'request_id': 'req-a5e54199-b6fe-4088-9b84-befaad945697'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.586265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6afc79afd84a1cbe28373376248bea', 'request_id': 'req-1fc2cf58-d9c7-411c-9a52-18fba473b543'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.593829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] The token cache is being invalidate because project 99f9cd121ea144659b3cebad5b604cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:02.594163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.594569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:02.594790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a5e54199-b6fe-4088-9b84-befaad945697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.596272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 945/1864] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:02 2022] DELETE /identity/v3/projects/99f9cd121ea144659b3cebad5b604cfa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:02.600902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaec7-29d7-4965-b49c-2853f8c19d0d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.601183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaec7-29d7-4965-b49c-2853f8c19d0d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.601370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] The token cache is being invalidate because project 8c6afc79afd84a1cbe28373376248bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:02.601484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddaec7-29d7-4965-b49c-2853f8c19d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.602068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.603538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.606098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 920/1865] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:02 2022] DELETE /identity/v3/projects/8c6afc79afd84a1cbe28373376248bea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:02.609630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.611211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:02.622557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4bddaec7-29d7-4965-b49c-2853f8c19d0d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:02.623766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4bddaec7-29d7-4965-b49c-2853f8c19d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:02.684010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2cf58-d9c7-411c-9a52-18fba473b543 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.690182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:02.691322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.691322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.691638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] PATH_INFO: `/v3/users/c9380b7998354043b24556f2d0ddae95` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.692658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9380b7998354043b24556f2d0ddae95)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:02.695010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:02.707738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 946/1866] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:02.716941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.717318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.717657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.739917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:02.741607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:02.754344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 947/1867] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:02.760661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.766217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9380b7998354043b24556f2d0ddae95'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.771198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099b47a-90dc-41a6-b5e9-bf75ab46a8bc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.777608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:02.778144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.778301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.778643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.779543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:02.779796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:02.781140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9380b7998354043b24556f2d0ddae95'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.782207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:02.798552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 948/1868] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:02.804656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.807743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9380b7998354043b24556f2d0ddae95'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.808498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9380b7998354043b24556f2d0ddae95'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.809113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9380b7998354043b24556f2d0ddae95'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:02.818761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cfb9b-ab9d-43c8-a585-3c1ac2a1ceda admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.830772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:02.831380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:02.831658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:02.831929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 921/1869] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:02 2022] DELETE /identity/v3/users/c9380b7998354043b24556f2d0ddae95 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:02.833953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:02.834887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:02.837619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:02.869766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 949/1870] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:02 2022] POST /identity/v3/projects => generated 359 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:02.872597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:02.874392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:02.943739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74852f1-bad6-40cc-8d2e-0f804e900a41 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:02.975224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:03.032335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.034838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.035831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.036313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.037155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.039880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.079221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 922/1871] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:02 2022] POST /identity/v3/users => generated 280 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:03.083100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.103575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1fda-098a-4f9c-bdc2-23ebec8d1921 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.109628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.112465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.112754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.113068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.113662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.120221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.142987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 950/1872] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:03.144054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.167606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20278dd0-9128-4529-886f-24173253adf3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.173175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.173940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.174289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.174653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.175388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.177255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.181651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.184507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.221252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035856-9e9f-41ea-a244-a594a25696b3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.232190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 923/1873] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:03.236106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.245096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.262027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.262312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.262584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] PATH_INFO: `/v3/projects/1a9b9043b295470a93d4526121bbe6a3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.273545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9b9043b295470a93d4526121bbe6a3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.277265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.287272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332544d-e2a6-4ab2-8da8-0ce080f3ed16 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.306968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.309237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.309525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.309837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] PATH_INFO: `/v3/projects/b9c99d06e9554294ab0897873cef5803/users/3696aaed29d54116aba6ec3198ec0967/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.360382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c99d06e9554294ab0897873cef5803, user_id=3696aaed29d54116aba6ec3198ec0967, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.366853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036b363-df3a-4372-b373-b115b5d5b3ef admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.381376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:03.432571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 924/1874] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:03 2022] PUT /identity/v3/projects/b9c99d06e9554294ab0897873cef5803/users/3696aaed29d54116aba6ec3198ec0967/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:03.443820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de2cc-18bc-4a07-aed5-30127f650bce None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.444411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de2cc-18bc-4a07-aed5-30127f650bce None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.444411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5de2cc-18bc-4a07-aed5-30127f650bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.460329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9b9043b295470a93d4526121bbe6a3', 'request_id': 'req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:03.490547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9b9043b295470a93d4526121bbe6a3', 'request_id': 'req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:03.517018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9b9043b295470a93d4526121bbe6a3', 'request_id': 'req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:03.546920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] The token cache is being invalidate because project 1a9b9043b295470a93d4526121bbe6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:03.547292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ef5de2cc-18bc-4a07-aed5-30127f650bce None None] MFA Rules not processed for user `3696aaed29d54116aba6ec3198ec0967`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:03.548555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ef5de2cc-18bc-4a07-aed5-30127f650bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.550407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:03.551775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fb2cb4a7-7ecc-4ce3-ab48-b0c217bf5a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:03.565353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 951/1875] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:03 2022] DELETE /identity/v3/projects/1a9b9043b295470a93d4526121bbe6a3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:03.566742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb018-9a93-4a42-bdf0-b6ba64c5120b None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.567023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb018-9a93-4a42-bdf0-b6ba64c5120b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.569521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bb018-9a93-4a42-bdf0-b6ba64c5120b None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.572790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 952/1876] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:38:03.576538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.576722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.577337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.661624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:03.666739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.719035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 925/1877] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:03.724380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78641-9a66-47f3-8b9f-fab2618e21bb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.724380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78641-9a66-47f3-8b9f-fab2618e21bb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.724380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78641-9a66-47f3-8b9f-fab2618e21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.752584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1be78641-9a66-47f3-8b9f-fab2618e21bb None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:03.753995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1be78641-9a66-47f3-8b9f-fab2618e21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.775249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 953/1878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:03.781384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.784163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.864977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 926/1879] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:03.866252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.866540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.866817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.876410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:03.891648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044ac7-ec4e-4086-a2d5-7000f7093f63 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.894326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:03.895958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.904516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.905196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.905479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.905793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.919331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 927/1880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:03.920342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.927761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:03.929015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:03.929218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:03.950416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 954/1881] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:03.951350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:03.968858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966720b6-60cc-461d-8fd5-dad708a5334f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:03.986097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:03.987169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:03.988278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:03.988714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:03.993975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32e11-5d66-4871-8391-90da4f767f4e service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.000981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.002921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.004657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.005685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.008148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.008594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.012668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:04.013114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.015001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.017215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 928/1882] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:04.017844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.019570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:04.041966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14502c7-22f1-4ec0-b575-fae84601e2ab service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.046998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.047645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.048084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.048376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] PATH_INFO: `/v3/users/3696aaed29d54116aba6ec3198ec0967` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.049708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3696aaed29d54116aba6ec3198ec0967)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.052534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.054343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 955/1883] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:04.064644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.076973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18263056-e6be-4812-8066-6431fbd129ca admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.088773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.089950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.090466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.092083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.093233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.097088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.152090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3696aaed29d54116aba6ec3198ec0967'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:04.161520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 956/1884] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:04.163227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.170853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3696aaed29d54116aba6ec3198ec0967'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:04.195452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:04.199203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3696aaed29d54116aba6ec3198ec0967'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:04.199953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3696aaed29d54116aba6ec3198ec0967'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:04.200793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0022ea21-6e9c-4de4-a598-07f8aa4252de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3696aaed29d54116aba6ec3198ec0967'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:04.220024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 929/1885] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:04 2022] DELETE /identity/v3/users/3696aaed29d54116aba6ec3198ec0967 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:04.224358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.226067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.226067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.270932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513df3ee-547e-414e-847f-b699917bc874 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.277418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:04.280081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:04.355626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.356540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.356926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.357211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.358126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.360525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.387513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 930/1886] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:04.405114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 957/1887] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:04.408311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.410368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:04.425830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ca5ca-8475-4571-9395-d88315b894e6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.434038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.436529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.436529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.436529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.436901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.440334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.454352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.454795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 931/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:04.457513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:04.462275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.491549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190242b-6956-46c3-8a32-fb463c7d436c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.511397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.512485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.513063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.513613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.514722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.516558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.531591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 932/1889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:04.533802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.546495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e16ac-936d-45de-920c-5ae704c1d8b6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.550217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179e3f-6f1a-41a3-8f8d-c4381eb2941b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.551183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.551628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.551908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.552175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.558513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.559471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.559976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.561048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] PATH_INFO: `/v3/projects/a0e5910506c3466ba9e2992d436242d2/users/08a669aa4c694fcab7cf4e289e5c8a9c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.564085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.566075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd759-ffe7-42e7-8317-bb2a70012968 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.579841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 958/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:04.584463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e5910506c3466ba9e2992d436242d2, user_id=08a669aa4c694fcab7cf4e289e5c8a9c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.588087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.614137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 933/1891] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:04 2022] PUT /identity/v3/projects/a0e5910506c3466ba9e2992d436242d2/users/08a669aa4c694fcab7cf4e289e5c8a9c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:04.616029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.616393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.616760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.652976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] MFA Rules not processed for user `08a669aa4c694fcab7cf4e289e5c8a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:04.653756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:04.733796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:04.755632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 959/1892] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:04.760337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.774952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:04.859543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0c66a-8910-4a65-8550-69a0a3051253 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:04.866011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:04.867066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:04.867557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:04.868217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:04.869055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:04.871385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:04.912574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 934/1893] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:04.917996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:04.934863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4657-b659-4b79-971d-29fd90746a48 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.145191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.145869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.146982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.147611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.148286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.160247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.228338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 960/1894] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:04 2022] POST /identity/v3/users => generated 300 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:05.232305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.248394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d08b4-dd2a-48e3-a261-c958568e0ad6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.261394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.261394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.261394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.261394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.262404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.262404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.291319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 935/1895] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:05.293060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.308550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d7d27-a43a-434e-afbc-854616b37f31 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.318144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.318979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.319386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.319663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] PATH_INFO: `/v3/projects/ee77745e0546456baaaaf19a19245606/users/117cf4b9e3c04fe3bbee3c538cce3c7a/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.346223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.348387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.360930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee77745e0546456baaaaf19a19245606, user_id=117cf4b9e3c04fe3bbee3c538cce3c7a, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.369145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.370463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81c66-605c-4a15-912a-8bf44e4ee2d8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.384697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.385350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.385687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.385988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] PATH_INFO: `/v3/projects/b9c99d06e9554294ab0897873cef5803` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.388681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c99d06e9554294ab0897873cef5803)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.393166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.425648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 961/1896] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:05 2022] PUT /identity/v3/projects/ee77745e0546456baaaaf19a19245606/users/117cf4b9e3c04fe3bbee3c538cce3c7a/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:05.431550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.535392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c99d06e9554294ab0897873cef5803', 'request_id': 'req-330c141a-f334-4142-bbc6-a71cc39513be'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:05.566172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c99d06e9554294ab0897873cef5803', 'request_id': 'req-330c141a-f334-4142-bbc6-a71cc39513be'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:05.582399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c99d06e9554294ab0897873cef5803', 'request_id': 'req-330c141a-f334-4142-bbc6-a71cc39513be'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:05.597138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043fc88-c249-4fc4-be2e-47ad0b0f3d59 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.626208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] The token cache is being invalidate because project b9c99d06e9554294ab0897873cef5803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:05.626589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:05.627236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-330c141a-f334-4142-bbc6-a71cc39513be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:05.629421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 936/1897] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:05 2022] DELETE /identity/v3/projects/b9c99d06e9554294ab0897873cef5803 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:05.635726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa610-2d8c-474d-b790-0395be9ee5ca None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.636090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa610-2d8c-474d-b790-0395be9ee5ca None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.636559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fa610-2d8c-474d-b790-0395be9ee5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.667748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f24fa610-2d8c-474d-b790-0395be9ee5ca None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:05.669509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f24fa610-2d8c-474d-b790-0395be9ee5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.702707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.703330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.703701 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.703958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.704605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.706237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.719628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 962/1898] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:05.723396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.726171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.735310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:05.741325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373d2ba-b247-4035-b963-8c95372d6970 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.750393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.751545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.752454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.753046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] PATH_INFO: `/v3/projects/ee77745e0546456baaaaf19a19245606/users/117cf4b9e3c04fe3bbee3c538cce3c7a/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.755866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee77745e0546456baaaaf19a19245606, user_id=117cf4b9e3c04fe3bbee3c538cce3c7a, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.761446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fde20-ee05-4714-b63d-fdb4483c7599 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.784391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 937/1899] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:05.785238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 963/1900] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:05 2022] PUT /identity/v3/projects/ee77745e0546456baaaaf19a19245606/users/117cf4b9e3c04fe3bbee3c538cce3c7a/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:05.796384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.796565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.796676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.796753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.796990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.797091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.813176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:05.819652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:05.823953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.836144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] MFA Rules not processed for user `117cf4b9e3c04fe3bbee3c538cce3c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:05.839361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.923396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 938/1901] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:05.929278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 964/1902] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:05.929442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.937115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.938648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:05.938888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711dfce-65d1-4715-9f61-4d358c9645d4 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.943702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.944309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.944616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.944884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.946393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:05.946705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.949054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:05.965405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 939/1903] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:05.966491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:05.978742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ede8fd-8327-4cdb-9069-1b79bde14460 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:05.984692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:05.984692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:05.984898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:05.985136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:05.985785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:05.987682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.016334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e156f86-6f6e-419a-aa42-83374604d24c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.021844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.022835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.023140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.023461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.028568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 940/1904] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:05 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:06.029940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.037412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.039296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.053887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 965/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:06.125355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6f634-df0c-4e81-9130-4df73bd2a8c1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.131961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.132925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.134050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.134603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.135661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.137751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.145509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.163138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f2df-1781-46c2-98b2-3a58b2ba696d service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.172868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.173953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.174247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.174627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] PATH_INFO: `/v3/users/08a669aa4c694fcab7cf4e289e5c8a9c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.176716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 941/1906] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:06 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:06.182684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.198786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5457a-3db8-49fb-a026-e44ca09f6e90 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.207567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a669aa4c694fcab7cf4e289e5c8a9c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.211979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.214212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.215113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.216248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.216451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.222701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.230029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.272026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 942/1907] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:06.274236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.292222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaebba-f552-4d7c-a49b-8e1059b187d0 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.308171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.317388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.317661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.317973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.318656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.324071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.329945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a669aa4c694fcab7cf4e289e5c8a9c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:06.352886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a669aa4c694fcab7cf4e289e5c8a9c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:06.353407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 943/1908] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:06.353800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a669aa4c694fcab7cf4e289e5c8a9c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:06.354694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a669aa4c694fcab7cf4e289e5c8a9c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:06.363235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.370368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:06.386446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211380-b8d6-42b7-9831-ae5d2290dc9c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.391859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.393048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.393432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.393834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] PATH_INFO: `/v3/projects/258bc29cfe704367ae143be8ce0c6c51/users/80360ad3ceb946b3a3a7f18e23de285c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.421695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=258bc29cfe704367ae143be8ce0c6c51, user_id=80360ad3ceb946b3a3a7f18e23de285c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.424764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee02b64-d54c-4661-8643-e28402ad2e7f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.426088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c1e3b77-c0cf-4b6f-8811-2dcfe75fffc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a669aa4c694fcab7cf4e289e5c8a9c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:06.429058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:06.457408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 966/1909] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:06 2022] DELETE /identity/v3/users/08a669aa4c694fcab7cf4e289e5c8a9c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:06.460373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 944/1910] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:06 2022] PUT /identity/v3/projects/258bc29cfe704367ae143be8ce0c6c51/users/80360ad3ceb946b3a3a7f18e23de285c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:06.471469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.471700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.471801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.472091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.472232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.472912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.510952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:06.512394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:06.540225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] MFA Rules not processed for user `80360ad3ceb946b3a3a7f18e23de285c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:06.543954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:06.548698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:06.669215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 967/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:06.714153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.715635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:06.722856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 945/1912] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:06.735675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:06.737519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:06.840024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430b1a4-7e3e-4703-90d5-b3126eff5747 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.844502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.845572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.846294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.846810 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.859249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.861480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.875462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 968/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:06.882011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3ef1e-2e4c-4572-8da6-5608d630ca8a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:06.893197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:06.893848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:06.894134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:06.894396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:06.913072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:06.914629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:06.947607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 946/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:07.378020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:07.379328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:07.407010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff7cd-296b-4e79-b56c-2175660bd3e0 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:07.416241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:07.419409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:07.419707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:07.420042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] PATH_INFO: `/v3/projects/a0e5910506c3466ba9e2992d436242d2` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:07.423760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e5910506c3466ba9e2992d436242d2)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:07.427531 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:07.440457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:07.443132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:07.481643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fe8e3-0a36-405c-a0f8-c76456f83fa3 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:07.487258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:07.488080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:07.488652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:07.489004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] PATH_INFO: `/v3/users/98d92629624f46dcb3675d777bf069d4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:07.490362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d92629624f46dcb3675d777bf069d4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:07.493248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:07.507564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e5910506c3466ba9e2992d436242d2', 'request_id': 'req-fabdd64d-ed14-4b68-8725-0bb9348616b5'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.516607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e5910506c3466ba9e2992d436242d2', 'request_id': 'req-fabdd64d-ed14-4b68-8725-0bb9348616b5'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.528121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e5910506c3466ba9e2992d436242d2', 'request_id': 'req-fabdd64d-ed14-4b68-8725-0bb9348616b5'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.543458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] The token cache is being invalidate because project a0e5910506c3466ba9e2992d436242d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:07.543779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.544508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.547241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 969/1915] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:07 2022] DELETE /identity/v3/projects/a0e5910506c3466ba9e2992d436242d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:07.550892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:07.552649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:07.564674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d92629624f46dcb3675d777bf069d4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.577439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:07.578281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d92629624f46dcb3675d777bf069d4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.599758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d92629624f46dcb3675d777bf069d4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.601051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d92629624f46dcb3675d777bf069d4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.602730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-47a64db6-83aa-4759-9317-ba39a33e3481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d92629624f46dcb3675d777bf069d4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.623679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 947/1916] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:07 2022] DELETE /identity/v3/users/98d92629624f46dcb3675d777bf069d4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:07.629139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:07.629506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:07.629877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:07.652646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdd64d-ed14-4b68-8725-0bb9348616b5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:07.655137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:07.656368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:07.678133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:07.721048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:07.721674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:07.721984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:07.722255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] PATH_INFO: `/v3/users/117cf4b9e3c04fe3bbee3c538cce3c7a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:07.723411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117cf4b9e3c04fe3bbee3c538cce3c7a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:07.725984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:07.747117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 948/1917] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:07.759251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:07.762653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:07.797956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117cf4b9e3c04fe3bbee3c538cce3c7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.810042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117cf4b9e3c04fe3bbee3c538cce3c7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.814155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117cf4b9e3c04fe3bbee3c538cce3c7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.814903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117cf4b9e3c04fe3bbee3c538cce3c7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.834918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117cf4b9e3c04fe3bbee3c538cce3c7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:07.856020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 970/1918] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:07 2022] DELETE /identity/v3/users/117cf4b9e3c04fe3bbee3c538cce3c7a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:07.869382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e6c2b-46cf-4111-ad0b-19b27cfe9863 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:07.937293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:07.938451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:07.938997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:07.939475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:07.942066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.071489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:08.073399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52760650-498d-4c9f-9638-096e6ebbab46 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:08.090044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 949/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:08.223248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:08.225040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.239954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e1e7-4eda-43a6-86e7-0cfd990792b0 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:08.245699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:08.246502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.247152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.247308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] PATH_INFO: `/v3/users/4aea76dc91e0450388634c2370646c74` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.248694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aea76dc91e0450388634c2370646c74)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:08.250790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:08.309201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:08.320144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aea76dc91e0450388634c2370646c74'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.331937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aea76dc91e0450388634c2370646c74'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.333280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aea76dc91e0450388634c2370646c74'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.334324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aea76dc91e0450388634c2370646c74'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.352774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aea76dc91e0450388634c2370646c74'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.370265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 971/1920] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:08 2022] DELETE /identity/v3/users/4aea76dc91e0450388634c2370646c74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:08.375252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.375559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.375810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.449404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:08.451931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.489096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:08.556246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 950/1921] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:08.598084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:08.599900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.689362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:08.693053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.708773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a78397-37e5-4629-b61f-281db03910b3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:08.714264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:08.715616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.715907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.716180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.721608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6475350-3080-4b21-bc64-64b438757d42 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:08.727543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:08.729499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:08.729625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:08.730599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.730973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.731344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] PATH_INFO: `/v3/projects/ee77745e0546456baaaaf19a19245606` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.732731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee77745e0546456baaaaf19a19245606)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:08.735888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:08.746267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 972/1922] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:08.816174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:08.818118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.868816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee77745e0546456baaaaf19a19245606', 'request_id': 'req-2b7953b8-c11f-4dfa-83df-f8d2269e6602'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.874476 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccbcb6-70e3-4772-9926-c45555c3d4c4 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:08.882153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee77745e0546456baaaaf19a19245606', 'request_id': 'req-2b7953b8-c11f-4dfa-83df-f8d2269e6602'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.893417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee77745e0546456baaaaf19a19245606', 'request_id': 'req-2b7953b8-c11f-4dfa-83df-f8d2269e6602'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.911810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] The token cache is being invalidate because project ee77745e0546456baaaaf19a19245606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:08.912973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.913999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b7953b8-c11f-4dfa-83df-f8d2269e6602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:08.915903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 951/1923] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:08 2022] DELETE /identity/v3/projects/ee77745e0546456baaaaf19a19245606 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:08.921394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0116b-bf56-42f6-813d-678904e12871 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.921394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0116b-bf56-42f6-813d-678904e12871 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.921394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0116b-bf56-42f6-813d-678904e12871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.948858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5ac0116b-bf56-42f6-813d-678904e12871 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:08.950275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5ac0116b-bf56-42f6-813d-678904e12871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:08.965558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:08.966270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:08.966679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:08.966919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] PATH_INFO: `/v3/projects/2a8a5cbbf5bd441bbd4d4339bc11e0d3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:08.968418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8a5cbbf5bd441bbd4d4339bc11e0d3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:08.971277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.048100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8a5cbbf5bd441bbd4d4339bc11e0d3', 'request_id': 'req-add9a601-03b1-4578-b494-bf533f622fb1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.066497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8a5cbbf5bd441bbd4d4339bc11e0d3', 'request_id': 'req-add9a601-03b1-4578-b494-bf533f622fb1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.071671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:09.075466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 952/1924] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:09.083646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.083934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.084349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.085439 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8a5cbbf5bd441bbd4d4339bc11e0d3', 'request_id': 'req-add9a601-03b1-4578-b494-bf533f622fb1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.107810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:09.109028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.116890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] The token cache is being invalidate because project 2a8a5cbbf5bd441bbd4d4339bc11e0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:09.117147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.118275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.120431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 973/1925] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:08 2022] DELETE /identity/v3/projects/2a8a5cbbf5bd441bbd4d4339bc11e0d3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:09.130761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.134512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.186542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:09.218175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 953/1926] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:09.224276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.236279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be5ba-9a7d-46fe-9eb3-55e06453d202 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.244232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.245145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.245830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.246272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.247110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:09.247592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.249403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.269771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a601-03b1-4578-b494-bf533f622fb1 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.274587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.275446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.275804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.276166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] PATH_INFO: `/v3/users/4eba16b3f4824d7988028b524eb4d8d9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.277572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eba16b3f4824d7988028b524eb4d8d9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.279860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.285932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 954/1927] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:09.286648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.288542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.303045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9c8a7-00ae-421e-986b-0965112512c9 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.310756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.311869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.312419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.312911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] PATH_INFO: `/v3/projects/b41cdf243e5b4010b8088fffeb36f9b5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.314527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41cdf243e5b4010b8088fffeb36f9b5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.317932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.346091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eba16b3f4824d7988028b524eb4d8d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.357068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eba16b3f4824d7988028b524eb4d8d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.357807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eba16b3f4824d7988028b524eb4d8d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.359091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eba16b3f4824d7988028b524eb4d8d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.373288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41cdf243e5b4010b8088fffeb36f9b5', 'request_id': 'req-d12482f8-8cf1-4da1-83c9-d559b56f03c7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.373977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eba16b3f4824d7988028b524eb4d8d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.382887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41cdf243e5b4010b8088fffeb36f9b5', 'request_id': 'req-d12482f8-8cf1-4da1-83c9-d559b56f03c7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.389004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 974/1928] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:09 2022] DELETE /identity/v3/users/4eba16b3f4824d7988028b524eb4d8d9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:09.389565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.390913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.393312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41cdf243e5b4010b8088fffeb36f9b5', 'request_id': 'req-d12482f8-8cf1-4da1-83c9-d559b56f03c7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.405491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] The token cache is being invalidate because project b41cdf243e5b4010b8088fffeb36f9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:09.405907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.407135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.409526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 955/1929] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:09 2022] DELETE /identity/v3/projects/b41cdf243e5b4010b8088fffeb36f9b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:09.414119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.416411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.504791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a763107-67de-41da-a691-b49ce2626b68 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.510823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.511098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.511437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.511983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.512619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.515028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.524442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12482f8-8cf1-4da1-83c9-d559b56f03c7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.530237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:09.531930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.532771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.533574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.534082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] PATH_INFO: `/v3/users/80244054079d46da9633f56d2d65040f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.535550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80244054079d46da9633f56d2d65040f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.537750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.557342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 975/1930] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:09.563746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.566513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.610442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80244054079d46da9633f56d2d65040f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.621549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80244054079d46da9633f56d2d65040f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.630283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:09.656506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5cc3c-69c0-4f5c-a989-f2d20cb38066 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.659844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80244054079d46da9633f56d2d65040f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.663063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80244054079d46da9633f56d2d65040f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.664809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.665317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80244054079d46da9633f56d2d65040f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.665434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.665684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.666060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.666789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.669091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.690449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 956/1931] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:09 2022] DELETE /identity/v3/users/80244054079d46da9633f56d2d65040f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:09.714001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 976/1932] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:09 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:09.717993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.719451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.787040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c2c4e-8730-4115-ae2c-99bc953163d6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.791681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.792279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.792555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.792829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.793467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.795086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.805779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 957/1933] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:09.809862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.819566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7caa8-a30c-418f-91eb-d6a6fc548c56 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.825167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.826206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.826513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.826846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.827505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.829162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.841018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 977/1934] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:09.847121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.865198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.868981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.871836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89ed2-cd46-40a3-a4c4-dcca9721633e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.877229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.877918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.878197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.878615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] PATH_INFO: `/v3/projects/cd3ac94fda16415b8fb74214f52149ba/users/0f242f059258431689f8bad2bb421523/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.883016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66866a51-8480-4267-8b55-6905f983ed49 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:09.888469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:09.889007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:09.889314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:09.889590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] PATH_INFO: `/v3/users/80360ad3ceb946b3a3a7f18e23de285c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:09.890793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80360ad3ceb946b3a3a7f18e23de285c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.892755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.900476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3ac94fda16415b8fb74214f52149ba, user_id=0f242f059258431689f8bad2bb421523, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:09.903666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:09.922461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 958/1935] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:09 2022] PUT /identity/v3/projects/cd3ac94fda16415b8fb74214f52149ba/users/0f242f059258431689f8bad2bb421523/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:09.923627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:09.925263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:09.984546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80360ad3ceb946b3a3a7f18e23de285c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.993584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80360ad3ceb946b3a3a7f18e23de285c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.994402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80360ad3ceb946b3a3a7f18e23de285c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:09.995339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80360ad3ceb946b3a3a7f18e23de285c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.004278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c6311-cc8e-4655-b91d-4fe154ad88ef admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.009481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2ca3bdbe-9184-49d9-b871-d9c949c1baa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80360ad3ceb946b3a3a7f18e23de285c'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.009872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.010565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.010784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.011163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] PATH_INFO: `/v3/projects/a242acb3214a4bde97846d32e0600cf1` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.012295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a242acb3214a4bde97846d32e0600cf1)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.014245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.026504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 978/1936] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:09 2022] DELETE /identity/v3/users/80360ad3ceb946b3a3a7f18e23de285c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:10.028008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.028283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.028553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.064920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] MFA Rules not processed for user `0f242f059258431689f8bad2bb421523`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.066334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.075754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a242acb3214a4bde97846d32e0600cf1', 'request_id': 'req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.080538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:10.084817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a242acb3214a4bde97846d32e0600cf1', 'request_id': 'req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.096300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a242acb3214a4bde97846d32e0600cf1', 'request_id': 'req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.105592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:10.112807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] The token cache is being invalidate because project a242acb3214a4bde97846d32e0600cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:10.113222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.114139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-19b3de6e-b87c-47c9-8a17-57f77cbdf57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.115898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 959/1937] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:09 2022] DELETE /identity/v3/projects/a242acb3214a4bde97846d32e0600cf1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:10.117096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749821e-15bf-4af1-914f-98eade8bcdad None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.117379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749821e-15bf-4af1-914f-98eade8bcdad None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.117699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749821e-15bf-4af1-914f-98eade8bcdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.138888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d749821e-15bf-4af1-914f-98eade8bcdad None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.140091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d749821e-15bf-4af1-914f-98eade8bcdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.143534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 979/1938] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.144354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.145621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.207071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 960/1939] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.208594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.208879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.209150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.213904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3958952-bef7-45dc-9800-3ac35fe32f62 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.218743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.219377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.219650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.220056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] PATH_INFO: `/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.221172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0bee9a8df24d8288bc942b6f8ce042)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.223122 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.229558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.230798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.238943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 961/1940] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.239734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.240991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.252643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31832c-1392-406c-893d-fb2f492f5c68 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.257862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.259032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.259370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.259707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.260375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.262411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.277824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0bee9a8df24d8288bc942b6f8ce042', 'request_id': 'req-a8c6b728-6294-455f-ab5b-2fee2ef085ab'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.285227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0bee9a8df24d8288bc942b6f8ce042', 'request_id': 'req-a8c6b728-6294-455f-ab5b-2fee2ef085ab'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.294984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0bee9a8df24d8288bc942b6f8ce042', 'request_id': 'req-a8c6b728-6294-455f-ab5b-2fee2ef085ab'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.296789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 962/1941] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:10.297628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.299248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.306983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] The token cache is being invalidate because project 6d0bee9a8df24d8288bc942b6f8ce042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:10.307270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.307927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a8c6b728-6294-455f-ab5b-2fee2ef085ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:10.312971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 980/1942] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:10 2022] DELETE /identity/v3/projects/6d0bee9a8df24d8288bc942b6f8ce042 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:10.312971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.312971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.312971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.331892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.333135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.361704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf70a8-c710-46f2-bcc7-87e11a5b8000 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.365315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.365943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.366219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.366487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.370907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.397403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 981/1943] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.400987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.400987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.407542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:10.415480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70791c9d-ec40-4188-9b04-a69e2450affb None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.422595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.423469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.424311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.425094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.426867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.428905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338c9d5-eead-4f9f-822c-7947c0aa3825 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.470208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 982/1944] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/users => generated 294 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:10.470208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.470208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.470208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.488027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.488982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.489926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.490357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.500780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 983/1945] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.501579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 963/1946] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:10.501692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.502718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.508725 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:10.512553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4131aa7-8b99-4076-b921-69c96dcf69dd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.513803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a31ed-c45b-46ce-a70b-9cf1fa4cec44 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.518563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.519170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.519449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.519817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.520775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.520897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:10.520987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.521060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.521129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.521660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.522390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.522489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.524049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b4686-7653-45bc-9651-316d9f37628c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.535437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 964/1947] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:10.539020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 984/1948] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:10.540986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.541347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.541537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.543375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.553843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865bb3d-c173-41da-bc5f-466419bbe326 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.559639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.560236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.560510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.560778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.561409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.563126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.563675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.565005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.573635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 985/1949] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:10.574535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.583051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 965/1950] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:10.583853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.585651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b296b-ce6c-4e1e-8ee8-bee234ac6a1c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.592392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.592879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.593226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.593416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.594092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.595602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec49d5-18fd-45ca-ac65-4b4bda300236 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.596143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.600890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.602006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.602006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.602845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] PATH_INFO: `/v3/projects/36308137cd68481391c5e417c1f156d2/users/480f6ff9ebd14d859ca7faca9ffa17cd/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.621510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36308137cd68481391c5e417c1f156d2, user_id=480f6ff9ebd14d859ca7faca9ffa17cd, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.624190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.627331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 986/1951] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:10.628419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.651240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 966/1952] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:10 2022] PUT /identity/v3/projects/36308137cd68481391c5e417c1f156d2/users/480f6ff9ebd14d859ca7faca9ffa17cd/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:10.651240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.745973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7d0e7-21d0-4459-a3f1-abdda8fb9881 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.753192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab26441-9275-4f00-88dd-4ee01a94335c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.759831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.760896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.762157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.762663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.763905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.767346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.768135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.768917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.769364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.770141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.770913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:10.771302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.773261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716425f-d634-4c9f-bbd6-8b99552d6ca5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.808159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 967/1953] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/users => generated 280 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:10.808343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 987/1954] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:10.809683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.810031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.810588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.812140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.824047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ee911-c1fb-4954-aeb0-90b6d1fb2c49 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.831880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.833254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.833716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.834260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.835097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.837042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.848784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 968/1955] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:10.850173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:10.870765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde6018-591b-4229-9b99-1dcd6ec87f2e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:10.876763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:10.877672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:10.878370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:10.878841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:10.879667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:10.882074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:10.893430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] MFA Rules not processed for user `480f6ff9ebd14d859ca7faca9ffa17cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:10.894794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:10.929059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 969/1956] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:10.932016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.007435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc362fb8-7e68-4fe4-9990-0cd32f5539dc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.012737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.013232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 988/1957] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:11.013346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.013542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.013902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.014091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.014676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.016297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.028202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 970/1958] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.028892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.040007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f1042-35e5-47ac-a117-05490aa3a3c2 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.044388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b289b-e8c4-41a3-a3b0-6ba68d40b25a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.046746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.048580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.048936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.049078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.049381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.049575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.049849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.050077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.050176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.050733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.051990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.053003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.070254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.072897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.080082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 989/1959] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/users => generated 286 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:11.081105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.087589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 971/1960] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:11.088324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.096734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbda43-0558-41a1-b669-dbdaef9f0353 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.158969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.159659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.159972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.160247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] PATH_INFO: `/v3/projects/249f15f39df7467abd0df1cbf7885a00/users/98040268782647fbacd074696f5787c3/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.160353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560731e-e20e-4906-926e-7982e893e536 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.165375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.166003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.166283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.166559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.167196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.168773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.175647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249f15f39df7467abd0df1cbf7885a00, user_id=98040268782647fbacd074696f5787c3, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.178488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 972/1961] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.179268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.182222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.189555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf5cab-1303-4dbc-9078-d68828a3172f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.194375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.195021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.195392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.195758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.196509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.198525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.203744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 990/1962] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:11 2022] PUT /identity/v3/projects/249f15f39df7467abd0df1cbf7885a00/users/98040268782647fbacd074696f5787c3/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:11.213001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.213001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.226533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 973/1963] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/users => generated 300 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:11.226533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.237005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f80530-4136-4e02-bc3d-a87545dbf645 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.272519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9f0e-a929-49b3-a7e0-b2dfe6b50fa6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.277073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702118-7177-4908-b003-2defada1d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.277693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702118-7177-4908-b003-2defada1d488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.278000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702118-7177-4908-b003-2defada1d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.278269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702118-7177-4908-b003-2defada1d488 admin admin] PATH_INFO: `/v3/projects/258bc29cfe704367ae143be8ce0c6c51` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.279668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25702118-7177-4908-b003-2defada1d488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258bc29cfe704367ae143be8ce0c6c51)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.281651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25702118-7177-4908-b003-2defada1d488 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.296508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.297123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.297403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.297677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.298345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.299926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055b1c-516b-49d0-a62a-4ae50ac41ce6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.310861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 974/1964] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.312178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.312422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.312724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.330142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258bc29cfe704367ae143be8ce0c6c51', 'request_id': 'req-25702118-7177-4908-b003-2defada1d488'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:11.337222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258bc29cfe704367ae143be8ce0c6c51', 'request_id': 'req-25702118-7177-4908-b003-2defada1d488'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:11.340192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] MFA Rules not processed for user `98040268782647fbacd074696f5787c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:11.341487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.345434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258bc29cfe704367ae143be8ce0c6c51', 'request_id': 'req-25702118-7177-4908-b003-2defada1d488'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:11.356466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] The token cache is being invalidate because project 258bc29cfe704367ae143be8ce0c6c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:11.356755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:11.357409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:11.358980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 991/1965] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:11 2022] DELETE /identity/v3/projects/258bc29cfe704367ae143be8ce0c6c51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:11.359733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.361004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.376337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.440267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702118-7177-4908-b003-2defada1d488 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.446855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.447407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.447688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.448014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.448740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.449269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.450488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabff4b-3514-4ce4-bd5f-5a860a222b16 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.462357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 975/1966] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:11.467376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 992/1967] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.467376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.467376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.467376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.470068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.472255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.489521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:11.490731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.499584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 993/1968] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:11.500489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.510897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08576483-1351-4df3-a0b0-a3a3f31fb5df None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.516669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.517812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.517812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.518061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] PATH_INFO: `/v3/projects/b088c2f28a1b4cc6a963d70dc3fba4e6/users/621a68b397c5447596402a324da66665/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.519119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.537372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b4c2d-8e3e-43da-b621-594032c30d61 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.541117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b088c2f28a1b4cc6a963d70dc3fba4e6, user_id=621a68b397c5447596402a324da66665, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.543943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.545484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.548778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.549058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.549416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.550331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.552324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720c67b-42f7-4afb-8db4-2e50a1eb2f2c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.560963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 976/1969] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:11 2022] PUT /identity/v3/projects/b088c2f28a1b4cc6a963d70dc3fba4e6/users/621a68b397c5447596402a324da66665/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:11.562183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.592832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 994/1970] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:11.595400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa294-2afa-486b-b710-d1ffc5092d2d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.595820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa294-2afa-486b-b710-d1ffc5092d2d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.596437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa294-2afa-486b-b710-d1ffc5092d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.624403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3d7fa294-2afa-486b-b710-d1ffc5092d2d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:11.626061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3d7fa294-2afa-486b-b710-d1ffc5092d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.668463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdeb6-f304-4b34-8de7-631083f6602e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.721304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 995/1971] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:11.727528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.729175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.729175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.759249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:11.760498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.763748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.764545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.764927 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.765306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] PATH_INFO: `/v3/projects/750292badb74432e8d7d9975f951dc28/users/593c6711b07b4fa0b9344e3fdaf49f9f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.774705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 996/1972] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:11.775879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.790298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d5fdf-488c-447f-a90b-203b179b2f2c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.791390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750292badb74432e8d7d9975f951dc28, user_id=593c6711b07b4fa0b9344e3fdaf49f9f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.795611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.796112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.796400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.796671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.797751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.798322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.799978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.817456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 977/1973] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:11 2022] PUT /identity/v3/projects/750292badb74432e8d7d9975f951dc28/users/593c6711b07b4fa0b9344e3fdaf49f9f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:11.818714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.829029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 997/1974] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:11.830598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.832674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:11.897829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665a32-c9fd-445b-b3fe-9763afc00fe7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.897829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.897829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.897829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.898217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.898217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:11.898217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.898217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.898620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae91c56-5481-473a-978d-39bd6a6a6498 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.905100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.907537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:11.911237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 978/1975] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:11.912886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.923633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4c54-8082-4b2f-a8ec-ca753bca97bb admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.928206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.928809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.929066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.929337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.930003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.931607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.941880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 979/1976] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.942674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.952453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820d60-268b-4bdb-be66-e10225b44a0c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.956765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.957008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.957373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.957573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.957793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.957888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.957974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.958143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.958762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.960362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.967738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.969158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.970797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 980/1977] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:11.971387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.979096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 998/1978] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:11.979777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:11.980498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51643a5-e4dc-4d41-9e7a-42d2a3fd4b85 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.985393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.985921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.986195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.986461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.987084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:11.988962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd0229-583b-40e3-bd53-eda24667f48f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:11.989079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19429202-6b3f-4044-84c5-560a6ebb17d8 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:11.993844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:11.994605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:11.994795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:11.995038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] PATH_INFO: `/v3/projects/750292badb74432e8d7d9975f951dc28/users/593c6711b07b4fa0b9344e3fdaf49f9f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:11.997140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750292badb74432e8d7d9975f951dc28, user_id=593c6711b07b4fa0b9344e3fdaf49f9f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.000745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.012492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 999/1979] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:11 2022] PUT /identity/v3/projects/750292badb74432e8d7d9975f951dc28/users/593c6711b07b4fa0b9344e3fdaf49f9f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:12.013404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.034944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 981/1980] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:11 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:12.036287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.036570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.036842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.075888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] MFA Rules not processed for user `593c6711b07b4fa0b9344e3fdaf49f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:12.078357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:12.093013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843df0d-d7ba-4fa8-9021-952f6af0bc20 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.171387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.172200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.172584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.172961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] PATH_INFO: `/v3/projects/f704d4e1990c43338d369399ec53e123/users/a21f438fc2504bdab0742beb1f4811a2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.183862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 982/1981] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:12.184767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.197839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ee103-225b-4633-b7ba-bc51393579d8 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.206107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f704d4e1990c43338d369399ec53e123, user_id=a21f438fc2504bdab0742beb1f4811a2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.208794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.213116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.214613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.215129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.215676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.216685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.220029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.235269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1000/1982] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:12 2022] PUT /identity/v3/projects/f704d4e1990c43338d369399ec53e123/users/a21f438fc2504bdab0742beb1f4811a2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:12.236119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.243684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:12.267959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 983/1983] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:12 2022] POST /identity/v3/users => generated 288 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:12.267959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.278598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bdde39-26b0-4033-a0e8-bab165802d99 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.288266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:12.319870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdbc67-f245-4160-b6f3-af0be351e96f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.326384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.327002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.327326 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.327593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.373946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.373946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.373946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.373946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.374239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.374239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.387271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 984/1984] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:12.388191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.400022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cecf3-88a6-4cfa-b8d7-6b0e3a4b17ce admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.405029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.405681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.406182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.406413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.407023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.408859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.422700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 985/1985] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:12.424024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.429348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.430853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.436165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87790f1-31e2-42d0-8ee0-fe04db7d104e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.441258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1001/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:12.441989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.455135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37072c8-3085-4915-b842-cd8c9fcd45ab service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.457154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.460455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.460762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.461052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] PATH_INFO: `/v3/projects/f704d4e1990c43338d369399ec53e123/users/a21f438fc2504bdab0742beb1f4811a2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.461174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.462449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.462731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.462999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.463626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.465264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.468965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f704d4e1990c43338d369399ec53e123, user_id=a21f438fc2504bdab0742beb1f4811a2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.471684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880f86b-0c21-4e89-8b32-6ff972861fbe admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.476765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:12.477580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1002/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:12.481258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.497658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 986/1988] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:12 2022] PUT /identity/v3/projects/f704d4e1990c43338d369399ec53e123/users/a21f438fc2504bdab0742beb1f4811a2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:12.504512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2fee9-22ee-46a3-8730-ecf3da78b87a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.522597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.522896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.523172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.573222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] MFA Rules not processed for user `a21f438fc2504bdab0742beb1f4811a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:12.577624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:12.586033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.587426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.587835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.588115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] PATH_INFO: `/v3/projects/e895bcb811cb435696232777ed7b81f1/users/fd1a2e9812144efaa181e503172cedc6/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.611527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e895bcb811cb435696232777ed7b81f1, user_id=fd1a2e9812144efaa181e503172cedc6, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:12.615131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d275-0ad1-41bc-b0d9-6c2ad7786062 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:12.634582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1003/1989] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:12 2022] PUT /identity/v3/projects/e895bcb811cb435696232777ed7b81f1/users/fd1a2e9812144efaa181e503172cedc6/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:12.645609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.646758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.647043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.701769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] MFA Rules not processed for user `fd1a2e9812144efaa181e503172cedc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:12.703141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:12.713416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 987/1990] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:12.737841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:12.739588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:12.768064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:12.827930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f196c-ef4c-4b5e-9c36-ce1a4ce9f7cd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:12.830178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1004/1991] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:12.909618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:12.910339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:12.910624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:12.910896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:12.994207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:13.014543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.016234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd2b4d-4335-40aa-9bce-254f03b0456e service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.024351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.034880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 988/1992] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:13.039104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14eefb-089d-4484-9d3c-943f20530c2a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.044143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.044826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.045142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.045387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.055734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.057409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.070053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1005/1993] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:13.117098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.117315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.117633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.177599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] MFA Rules not processed for user `621a68b397c5447596402a324da66665`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:13.179001 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:13.298248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.313634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b64bf-2336-4f98-9141-2658d1c8ef8f service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.325512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.326941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.327229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.329789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.343793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 989/1994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:13.344723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.534190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.535797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.556668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1006/1995] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:13.565950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42dec3-6826-4d29-862f-1522fc9c1bfb None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.584499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.585139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.585422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.585701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.586982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.589116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.650119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 990/1996] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:13 2022] POST /identity/v3/projects => generated 373 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:13.655068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.676042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a240f0-d83b-4703-a6ed-c73795d105e9 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.840584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.841170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.841447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.841741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.845266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.846903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.910765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.914264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1007/1997] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:13 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:13.915894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.931170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fe32-6287-498c-a66b-739e3ee7a40f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.950069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.950871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.951162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.951513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.952192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:13.954111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:13.969844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1008/1998] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:13.972704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:13.984754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b215-e0c1-490c-8cd1-46794de0c32a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.989676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:13.990392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:13.990866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:13.990978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] PATH_INFO: `/v3/projects/8d3f9376faaf4f349804a319c3fb27a9/users/48751dca3f03458f8d07f6ac7d538566/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:13.995735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83902800-bfab-420d-8544-c0775513d44f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:13.999454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:14.000217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:14.000501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:14.000773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:14.002639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:14.010571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3f9376faaf4f349804a319c3fb27a9, user_id=48751dca3f03458f8d07f6ac7d538566, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:14.014023 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:14.025605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:14.034192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1009/1999] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:13 2022] PUT /identity/v3/projects/8d3f9376faaf4f349804a319c3fb27a9/users/48751dca3f03458f8d07f6ac7d538566/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:14.038034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:14.070411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:14.089165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:14.090558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:14.100509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 991/2000] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:14.119832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f23fd2-2f05-44f3-880a-d1a4c258b6ba admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:14.127947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:14.129069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:14.129392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:14.129899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:14.130825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:14.132835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63158af-5826-4f52-bdce-9814905d48c8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:14.145524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1010/2001] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:14.149799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:14.163783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941249d-7298-46ed-9f8f-4da6ded07bb7 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:14.169103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:14.170868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:14.171305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:14.171754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] PATH_INFO: `/v3/projects/8d3f9376faaf4f349804a319c3fb27a9/users/48751dca3f03458f8d07f6ac7d538566/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:14.174679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d3f9376faaf4f349804a319c3fb27a9, user_id=48751dca3f03458f8d07f6ac7d538566, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:14.178008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c46a8-3d21-4039-aa08-6c7ce440e0ff admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:14.196506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 992/2002] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:14 2022] PUT /identity/v3/projects/8d3f9376faaf4f349804a319c3fb27a9/users/48751dca3f03458f8d07f6ac7d538566/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:15.342613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:15.343121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:15.343225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:15.417078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] MFA Rules not processed for user `48751dca3f03458f8d07f6ac7d538566`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:15.418362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:15.526925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1011/2003] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:15.538099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:15.538630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:15.538630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:15.591797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] MFA Rules not processed for user `621a68b397c5447596402a324da66665`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:15.593514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:15.733125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 993/2004] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:15.745226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:15.748097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:15.860790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23941407-bd13-48f9-bd2b-5b6a12d94382 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:15.886063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:15.886702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:15.887103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:15.887408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:15.896982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:15.898796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554590-ddd6-40bd-9a70-4af622067a5e service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:15.929117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1012/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:17.156904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:17.236847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9362-56e9-4da3-82be-ac68a338fd40 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:17.254936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:17.255810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:17.256289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:17.256566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] PATH_INFO: `/v3/users/98040268782647fbacd074696f5787c3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:17.257813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98040268782647fbacd074696f5787c3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:17.260320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:17.313117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98040268782647fbacd074696f5787c3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:17.314329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:17.323101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98040268782647fbacd074696f5787c3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:17.336488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98040268782647fbacd074696f5787c3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:17.337173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98040268782647fbacd074696f5787c3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:17.337808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98040268782647fbacd074696f5787c3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:17.349995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 994/2006] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:17 2022] DELETE /identity/v3/users/98040268782647fbacd074696f5787c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:17.354569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:17.355055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:17.355160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:17.373982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:17.375187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:17.400400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:17.435484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1013/2007] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:17.446423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:17.447974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:17.505841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82967-0e9f-40f9-88a1-28e34060de8b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:17.509980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:17.510579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:17.510854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:17.511124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:17.520474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:17.521935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:17.532095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 995/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:18.033871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:18.035351 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:18.062996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8d357-7e60-4ad7-a28c-5fddd396c604 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:18.075321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:18.076260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:18.076880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:18.077369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] PATH_INFO: `/v3/projects/249f15f39df7467abd0df1cbf7885a00` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:18.102018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249f15f39df7467abd0df1cbf7885a00)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:18.110891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:18.248407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249f15f39df7467abd0df1cbf7885a00', 'request_id': 'req-28e5679b-1e6b-4116-ba62-bd6b8be43c10'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.266052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249f15f39df7467abd0df1cbf7885a00', 'request_id': 'req-28e5679b-1e6b-4116-ba62-bd6b8be43c10'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.283817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249f15f39df7467abd0df1cbf7885a00', 'request_id': 'req-28e5679b-1e6b-4116-ba62-bd6b8be43c10'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.306793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] The token cache is being invalidate because project 249f15f39df7467abd0df1cbf7885a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:18.307183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.308088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.310087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1014/2009] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:18 2022] DELETE /identity/v3/projects/249f15f39df7467abd0df1cbf7885a00 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:18.314209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:18.329127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a605b2-f7d3-4425-909f-5bf53122d180 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:18.527172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:18.527350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:18.527637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:18.527908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] PATH_INFO: `/v3/users/a21f438fc2504bdab0742beb1f4811a2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:18.530238 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21f438fc2504bdab0742beb1f4811a2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:18.532698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:18.621548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21f438fc2504bdab0742beb1f4811a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.632103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21f438fc2504bdab0742beb1f4811a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.646944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:18.652634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21f438fc2504bdab0742beb1f4811a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.655558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21f438fc2504bdab0742beb1f4811a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.656894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21f438fc2504bdab0742beb1f4811a2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:18.700973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 996/2010] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:18 2022] DELETE /identity/v3/users/a21f438fc2504bdab0742beb1f4811a2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:18.787836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:18.791037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:18.934483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5679b-1e6b-4116-ba62-bd6b8be43c10 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.013518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.014452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.014682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.015069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.017235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:19.044579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:19.096715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.098328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24666e1-6152-4c52-a13b-b8770d343e65 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:19.108184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1015/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:19.254617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:19.256498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:19.352482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19bd2-2de0-4521-b77b-dba7dec889a0 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.357347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.358012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.358292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.358562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] PATH_INFO: `/v3/projects/f704d4e1990c43338d369399ec53e123` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.359758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f704d4e1990c43338d369399ec53e123)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.361667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:19.415769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f704d4e1990c43338d369399ec53e123', 'request_id': 'req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:19.423706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f704d4e1990c43338d369399ec53e123', 'request_id': 'req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:19.431601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f704d4e1990c43338d369399ec53e123', 'request_id': 'req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:19.454225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] The token cache is being invalidate because project f704d4e1990c43338d369399ec53e123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:19.454854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:19.455891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-0ca62ee7-c6fa-4ba7-8252-fa71923a5a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:19.462225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 997/2012] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:19 2022] DELETE /identity/v3/projects/f704d4e1990c43338d369399ec53e123 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:19.465697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.466072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.466459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.501281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:19.502940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:19.598070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1016/2013] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:19.599919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.600331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.600667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.641980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:19.643752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:19.669257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 998/2014] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:19.674555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:19.701946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2e8d7-7ed8-439c-b929-45290d60398f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.717113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.720355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.720642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.720922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.721581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:19.721944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.723550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:19.745884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1017/2015] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:19.750020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:19.761335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be4968-9d6f-4df2-a9d4-0b90e177178e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.768184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.769102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.769393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.769715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.770456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.772365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:19.821884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 999/2016] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:19 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:19.822495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:19.842572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0532-5d8b-4ba0-ade1-addd57230d43 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.916850 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.917536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.917941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.918285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.919136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.921084 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:19.955139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1018/2017] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:19 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:19.956458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:19.973685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adb46e-c4a2-4f17-b047-541f69557d7f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:19.979426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:19.980116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:19.980468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:19.980811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:19.981548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:19.983347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.019898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1000/2018] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:20.023571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.042922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fdf0-3e88-44f4-a78a-10a8215e3c5f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.059840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.062361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.063226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.063226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.063677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.068644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab2071-d2ca-4fbd-a572-c70fdbe3f96c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.099289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1019/2019] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:20.100443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.123801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216eeca-ca8a-49b3-adb6-ba44f0eb1dbb admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.131818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.132568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.133077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.133362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] PATH_INFO: `/v3/projects/cea1b94217ea4be6a743cb141a1af73a/users/816e11f5c16e4a21bfbccce1f59e5616/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.160297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea1b94217ea4be6a743cb141a1af73a, user_id=816e11f5c16e4a21bfbccce1f59e5616, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.167177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.205776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1001/2020] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:20 2022] PUT /identity/v3/projects/cea1b94217ea4be6a743cb141a1af73a/users/816e11f5c16e4a21bfbccce1f59e5616/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:20.214455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.214750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.215022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.270762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] MFA Rules not processed for user `816e11f5c16e4a21bfbccce1f59e5616`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:20.272132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:20.293432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:20.375254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1020/2021] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:20.380603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.407180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:20.479803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56f8c-c16b-499e-990d-54e6d8ed61ca admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.485794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.486703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.487245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.487982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.489163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.491355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.541691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1002/2022] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:20 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:20.543083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.557878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db520dde-b878-4184-b566-86e78b7bcadb None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.620719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.621599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.621911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.622187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.622847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.624801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.655670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1021/2023] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:20 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:20.657067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.672681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e8e-8349-4b01-8133-9b5b4ca9d888 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.689794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.690477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.691103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.691103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.691942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.697738 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.709773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1003/2024] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:20.712316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.723866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a084e-2468-4f93-9cc8-c33bfc5e67af admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.736974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.737752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.738118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.738463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] PATH_INFO: `/v3/projects/5a8d4f51650944e995240ec173f30500/users/830ef26e1a464c6383925c486226d176/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.763779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8d4f51650944e995240ec173f30500, user_id=830ef26e1a464c6383925c486226d176, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.766571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.793314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1022/2025] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:20 2022] PUT /identity/v3/projects/5a8d4f51650944e995240ec173f30500/users/830ef26e1a464c6383925c486226d176/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:20.798529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.812793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e07af2-0a47-4262-ac6f-02a4296c872c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.903628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.904288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.904702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.905039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.905768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.907724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14322b15-544a-4abb-9530-2a6377c7e72f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.920997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1004/2026] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:20.927259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:20.960375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32727-2a73-4d3d-ab71-d92e1fd80364 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:20.966480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:20.967327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.967619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.967895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] PATH_INFO: `/v3/projects/5a8d4f51650944e995240ec173f30500/users/830ef26e1a464c6383925c486226d176/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:20.970235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8d4f51650944e995240ec173f30500, user_id=830ef26e1a464c6383925c486226d176, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:20.972941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:20.988124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1023/2027] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:20 2022] PUT /identity/v3/projects/5a8d4f51650944e995240ec173f30500/users/830ef26e1a464c6383925c486226d176/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:20.996714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:20.997015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:20.997290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.044908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] MFA Rules not processed for user `830ef26e1a464c6383925c486226d176`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:21.046530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:21.144142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1005/2028] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:21.183265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:21.184974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:21.282817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034913-16fd-481a-b4ea-0cd5b5033e1b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:21.286749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:21.287359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.287637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.287908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.298429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:21.300504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac186983-03f3-4986-a484-a3d1eb116a21 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:21.312978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1024/2029] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:21.348562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:21.363120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:21.432886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba73e4-7272-4909-8283-0c952bd87174 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:21.438817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:21.439512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.439835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.440131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] PATH_INFO: `/v3/users/816e11f5c16e4a21bfbccce1f59e5616` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.441283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] RBAC: Authorizing `identity:delete_user(user_id=816e11f5c16e4a21bfbccce1f59e5616)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:21.443260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:21.526712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816e11f5c16e4a21bfbccce1f59e5616'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.538014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816e11f5c16e4a21bfbccce1f59e5616'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.552444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816e11f5c16e4a21bfbccce1f59e5616'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.553336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816e11f5c16e4a21bfbccce1f59e5616'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.554258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816e11f5c16e4a21bfbccce1f59e5616'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.573780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1006/2030] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:21 2022] DELETE /identity/v3/users/816e11f5c16e4a21bfbccce1f59e5616 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:21.577099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.577481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.577860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.605072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:21.606499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:21.618463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:21.693229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1025/2031] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:21.764257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:21.765680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:21.837569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:21.839156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:21.842154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739441f-2c2a-4196-b2fd-687bafc7068b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:21.846768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:21.847381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.847658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.848028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.852852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19674-ee7b-4a65-b74b-7a92b63d5932 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:21.864808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:21.865537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.865920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.866396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] PATH_INFO: `/v3/users/0f242f059258431689f8bad2bb421523` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:21.868801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f242f059258431689f8bad2bb421523)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:21.870627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:21.870928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:21.872204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a334bfe-9d89-42d8-9205-8e57e434d743 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:21.887696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1007/2032] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:21.931059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f242f059258431689f8bad2bb421523'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.939964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f242f059258431689f8bad2bb421523'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.940962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f242f059258431689f8bad2bb421523'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.941751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f242f059258431689f8bad2bb421523'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.954715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f242f059258431689f8bad2bb421523'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:21.970138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1026/2033] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:21 2022] DELETE /identity/v3/users/0f242f059258431689f8bad2bb421523 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:21.974465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:21.974962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:21.975311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:22.010804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:22.012129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:22.043992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:22.110611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1008/2034] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:22.132662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:22.134402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:22.234003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdaf84-8164-4344-a152-f35a41c33ea7 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:22.237647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:22.238294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:22.238573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:22.238842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:22.248647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:22.250159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:22.261983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1027/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:23.184316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:23.186196 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:23.202466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5268b-bed1-4a7d-a646-47bd1f530e28 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:23.207972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:23.208606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:23.209354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:23.209354 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] PATH_INFO: `/v3/projects/cea1b94217ea4be6a743cb141a1af73a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:23.210398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea1b94217ea4be6a743cb141a1af73a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:23.213297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:23.288795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea1b94217ea4be6a743cb141a1af73a', 'request_id': 'req-a1e79d58-85ff-4ebb-b619-74415c19a6f8'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.298846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea1b94217ea4be6a743cb141a1af73a', 'request_id': 'req-a1e79d58-85ff-4ebb-b619-74415c19a6f8'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.307007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea1b94217ea4be6a743cb141a1af73a', 'request_id': 'req-a1e79d58-85ff-4ebb-b619-74415c19a6f8'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.318480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] The token cache is being invalidate because project cea1b94217ea4be6a743cb141a1af73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:23.318480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.318756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.320380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1009/2036] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:23 2022] DELETE /identity/v3/projects/cea1b94217ea4be6a743cb141a1af73a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:23.325070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:23.337644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcb387-38a4-489f-872f-f0d61e6e803f service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:23.374024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:23.433390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:23.438837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:23.489418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:23.490704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:23.490994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:23.491274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] PATH_INFO: `/v3/users/830ef26e1a464c6383925c486226d176` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:23.493711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=830ef26e1a464c6383925c486226d176)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:23.495994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:23.541152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e79d58-85ff-4ebb-b619-74415c19a6f8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:23.548710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:23.549612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:23.550272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:23.550680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] PATH_INFO: `/v3/projects/cd3ac94fda16415b8fb74214f52149ba` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:23.552513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3ac94fda16415b8fb74214f52149ba)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:23.554879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:23.628594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3ac94fda16415b8fb74214f52149ba', 'request_id': 'req-5b27d6a4-b334-445b-a389-994c59097993'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.629480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830ef26e1a464c6383925c486226d176'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.646380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3ac94fda16415b8fb74214f52149ba', 'request_id': 'req-5b27d6a4-b334-445b-a389-994c59097993'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.649108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:23.657646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3ac94fda16415b8fb74214f52149ba', 'request_id': 'req-5b27d6a4-b334-445b-a389-994c59097993'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.674464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] The token cache is being invalidate because project cd3ac94fda16415b8fb74214f52149ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:23.674464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.674464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.676889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1010/2037] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:23 2022] DELETE /identity/v3/projects/cd3ac94fda16415b8fb74214f52149ba => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:23.685424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830ef26e1a464c6383925c486226d176'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.686388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830ef26e1a464c6383925c486226d176'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.687040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830ef26e1a464c6383925c486226d176'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.687414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:23.690997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:23.708051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830ef26e1a464c6383925c486226d176'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.724157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1028/2038] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:23 2022] DELETE /identity/v3/users/830ef26e1a464c6383925c486226d176 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:23.772565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27d6a4-b334-445b-a389-994c59097993 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:23.837113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:23.837952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:23.838300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:23.838771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] PATH_INFO: `/v3/users/480f6ff9ebd14d859ca7faca9ffa17cd` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:23.840008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480f6ff9ebd14d859ca7faca9ffa17cd)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:23.841974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:23.910046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480f6ff9ebd14d859ca7faca9ffa17cd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.918052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480f6ff9ebd14d859ca7faca9ffa17cd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.933283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480f6ff9ebd14d859ca7faca9ffa17cd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.934252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480f6ff9ebd14d859ca7faca9ffa17cd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.935029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-fd36840a-8c40-4e1f-965c-a1132c96b145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480f6ff9ebd14d859ca7faca9ffa17cd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:23.952547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1011/2039] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:23 2022] DELETE /identity/v3/users/480f6ff9ebd14d859ca7faca9ffa17cd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:24.028051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.029646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:24.043273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf308c10-a713-4d9e-85db-5c859b6d7f1a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.121686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.122740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.123090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.123363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] PATH_INFO: `/v3/projects/5a8d4f51650944e995240ec173f30500` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.124521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8d4f51650944e995240ec173f30500)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.126483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.175966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8d4f51650944e995240ec173f30500', 'request_id': 'req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.176986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:24.184278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8d4f51650944e995240ec173f30500', 'request_id': 'req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.193230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8d4f51650944e995240ec173f30500', 'request_id': 'req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.205117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] The token cache is being invalidate because project 5a8d4f51650944e995240ec173f30500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:24.205422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.206118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-a38b7dcd-5c01-49a0-b0f0-6f2b4a79f2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.207648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1029/2040] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:24 2022] DELETE /identity/v3/projects/5a8d4f51650944e995240ec173f30500 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:24.214295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.214854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.214854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.235151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:24.236413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:24.242212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:24.306568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1012/2041] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:24.314706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.314990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.315259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.338366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:24.339752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:24.348510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1030/2042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:24.354156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.364261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0978a1-6d67-4b8d-960d-2084f59a5442 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.369861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.371192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.371384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.371656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.372313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:24.372611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.374842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.387335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1013/2043] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:24.391457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.401567 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddb7c6-96d5-4f44-ae9d-863c2256148f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.406282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.406871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.407149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.407412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.408044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.410220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.482464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1031/2044] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:24.484186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.502020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5047e-8800-48de-9c84-58d20839b03f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.610447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.611966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.612401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.612798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.613541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.616176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.687711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1014/2045] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:24.693144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.699679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.705601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:24.715339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b5096-ef8b-4370-b989-9a3ca4cd92f8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.736041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.739018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.740045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.740420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.742616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556740b-b60a-4a95-b9da-8db40f0da954 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.743987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.749684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.764404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.765052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.765481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.766133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] PATH_INFO: `/v3/users/fd1a2e9812144efaa181e503172cedc6` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.768187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1a2e9812144efaa181e503172cedc6)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.770149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.787230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1032/2046] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:24.792683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.829176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcaa76-bdd4-47fe-a6ab-0d1900d47632 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.837770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.838552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.838855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.839233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.840083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.841977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.854541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1033/2047] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:24.858738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:24.874880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b50e1c-a9f1-4576-bd84-5c48c102b336 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:24.877462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1a2e9812144efaa181e503172cedc6'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.881884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:24.882807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.883291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.883702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] PATH_INFO: `/v3/projects/5637509fcb254ccab343d6c1db704a49/users/51058e9a0e884a939bad12fa4ba659bf/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.886962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1a2e9812144efaa181e503172cedc6'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.904790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5637509fcb254ccab343d6c1db704a49, user_id=51058e9a0e884a939bad12fa4ba659bf, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:24.908603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da265b-0818-47f2-9ee1-ab7b62d0fbec admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:24.910596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1a2e9812144efaa181e503172cedc6'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.911806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1a2e9812144efaa181e503172cedc6'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.912540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b58f053c-75a2-4e01-b8c8-0de8cbf3b10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1a2e9812144efaa181e503172cedc6'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:24.929792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1034/2048] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:24 2022] PUT /identity/v3/projects/5637509fcb254ccab343d6c1db704a49/users/51058e9a0e884a939bad12fa4ba659bf/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:24.931065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:24.943164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.943461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.943819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.952948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1015/2049] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:24 2022] DELETE /identity/v3/users/fd1a2e9812144efaa181e503172cedc6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:24.958733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:24.959232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:24.959606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:24.982825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] MFA Rules not processed for user `51058e9a0e884a939bad12fa4ba659bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:24.984076 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:24.985438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:24.987126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.125350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1016/2050] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:25.127785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.130010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.135921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1035/2051] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:25.137088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.140274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.145963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2e7a-5815-4696-9b5f-64e0589eb022 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.152333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.152970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.153297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.153570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] PATH_INFO: `/v3/projects/36308137cd68481391c5e417c1f156d2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.155449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36308137cd68481391c5e417c1f156d2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.157491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.204458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec975c17-359e-4113-ba5e-7d7afe132089 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.209803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:25.221671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36308137cd68481391c5e417c1f156d2', 'request_id': 'req-acd9772c-37ff-432b-bb31-b8a44504553f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.233259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36308137cd68481391c5e417c1f156d2', 'request_id': 'req-acd9772c-37ff-432b-bb31-b8a44504553f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.240694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36308137cd68481391c5e417c1f156d2', 'request_id': 'req-acd9772c-37ff-432b-bb31-b8a44504553f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.257335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] The token cache is being invalidate because project 36308137cd68481391c5e417c1f156d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:25.258471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.259118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.260637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1017/2052] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:25 2022] DELETE /identity/v3/projects/36308137cd68481391c5e417c1f156d2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:25.261410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.264371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.264547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.265171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.265541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.265906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.267843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.333621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9772c-37ff-432b-bb31-b8a44504553f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.338251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.339783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.340360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.340799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.341072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.341481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.342140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.344038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.350498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1036/2053] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:25.351266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.352803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.366770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d28c-790e-4327-b215-f2c9827684a0 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.375621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.376543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.377106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.378523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] PATH_INFO: `/v3/users/593c6711b07b4fa0b9344e3fdaf49f9f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.380038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593c6711b07b4fa0b9344e3fdaf49f9f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.381892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1018/2054] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:25 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:25.382454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.385300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.400018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:25.463430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593c6711b07b4fa0b9344e3fdaf49f9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.478400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593c6711b07b4fa0b9344e3fdaf49f9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.479262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593c6711b07b4fa0b9344e3fdaf49f9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.479520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe41ed-0a1e-491c-8b86-126b7d3c1a51 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.480124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593c6711b07b4fa0b9344e3fdaf49f9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.484790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.485400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.485674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.485988 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.486622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.488891 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.498359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593c6711b07b4fa0b9344e3fdaf49f9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:25.525155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1019/2056] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:25 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:25.525496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1037/2056] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:25 2022] DELETE /identity/v3/users/593c6711b07b4fa0b9344e3fdaf49f9f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:25.534791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.539834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.553400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66be361-c74f-4795-9822-8487425ed1a3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.633410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.634467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.634877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.636489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.637544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.640081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.653442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1020/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:25.658020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.674908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3db76d-980d-483c-b80f-bdaadc65c2a9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.686754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.686754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.686754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.686754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] PATH_INFO: `/v3/projects/dfe180643a2c4f1e9c7051429984f58a/users/474437b44ebc41919618faa6b68abec2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.724109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe180643a2c4f1e9c7051429984f58a, user_id=474437b44ebc41919618faa6b68abec2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.727543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.760307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1038/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:25 2022] PUT /identity/v3/projects/dfe180643a2c4f1e9c7051429984f58a/users/474437b44ebc41919618faa6b68abec2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:25.764569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.780110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39db251-91b5-4387-916e-5d60704a18b5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.836009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.842088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:25.858723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:25.903356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.904042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.904425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.904585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.905240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.906948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.928438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1021/2059] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:25.933205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:25.948818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553442-19a9-4471-8451-6d74131fd368 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.966144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:25.966879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:25.967398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:25.967793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] PATH_INFO: `/v3/projects/dfe180643a2c4f1e9c7051429984f58a/users/474437b44ebc41919618faa6b68abec2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:25.971599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe180643a2c4f1e9c7051429984f58a, user_id=474437b44ebc41919618faa6b68abec2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:25.978378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cfd9d-a8f0-45ba-b045-561b88ffc76c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:25.991588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dbb72-3d76-479a-9c4c-c5cdfb6b41e9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:25.997767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1022/2060] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:25 2022] PUT /identity/v3/projects/dfe180643a2c4f1e9c7051429984f58a/users/474437b44ebc41919618faa6b68abec2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:26.010373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.010832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.011120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.093480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] MFA Rules not processed for user `474437b44ebc41919618faa6b68abec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:26.094756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.106471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:26.137244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.137763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.138037 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.138314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] PATH_INFO: `/v3/projects/e895bcb811cb435696232777ed7b81f1` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.140334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e895bcb811cb435696232777ed7b81f1)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.147580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.243087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1023/2061] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:26.243656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e895bcb811cb435696232777ed7b81f1', 'request_id': 'req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.243790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.243790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.249035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e895bcb811cb435696232777ed7b81f1', 'request_id': 'req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.261479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e895bcb811cb435696232777ed7b81f1', 'request_id': 'req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.270965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3665a-2833-451d-9ad4-9b951b14cac0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.293411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] The token cache is being invalidate because project e895bcb811cb435696232777ed7b81f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:26.293905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.294718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.300692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1039/2062] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:25 2022] DELETE /identity/v3/projects/e895bcb811cb435696232777ed7b81f1 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:26.301884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.303762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.378473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.379289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.379869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.380233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] PATH_INFO: `/v3/projects/750292badb74432e8d7d9975f951dc28` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.382023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=750292badb74432e8d7d9975f951dc28)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.384283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.412212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:26.429718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc03f6-c0ff-48f6-8697-108ba6f2a575 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.434034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.435383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.435796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.436075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.438191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.479040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750292badb74432e8d7d9975f951dc28', 'request_id': 'req-78956961-211d-4f3a-bc6c-c8cb7da98d7e'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.503438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750292badb74432e8d7d9975f951dc28', 'request_id': 'req-78956961-211d-4f3a-bc6c-c8cb7da98d7e'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.516253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750292badb74432e8d7d9975f951dc28', 'request_id': 'req-78956961-211d-4f3a-bc6c-c8cb7da98d7e'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.522035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.524776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad916b74-db4a-404e-be3c-261c5cf993a7 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.534689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] The token cache is being invalidate because project 750292badb74432e8d7d9975f951dc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:26.535261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.535987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-78956961-211d-4f3a-bc6c-c8cb7da98d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:26.537958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1024/2063] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:26 2022] DELETE /identity/v3/projects/750292badb74432e8d7d9975f951dc28 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:26.539922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1040/2064] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:26.540665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05cb0-d2b4-4a34-b82b-788f396cdc32 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.541084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05cb0-d2b4-4a34-b82b-788f396cdc32 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.541395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd05cb0-d2b4-4a34-b82b-788f396cdc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.544001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.544739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.545501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.572616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-fcd05cb0-d2b4-4a34-b82b-788f396cdc32 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:26.574478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fcd05cb0-d2b4-4a34-b82b-788f396cdc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.574798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:26.577032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.616840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:26.691364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1041/2065] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:26.692277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.694779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.700776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1025/2066] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:26.702208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c09-a4f4-43ab-9e5c-f5565e9986a2 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.702496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c09-a4f4-43ab-9e5c-f5565e9986a2 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.702772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c09-a4f4-43ab-9e5c-f5565e9986a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.726523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f3ea2c09-a4f4-43ab-9e5c-f5565e9986a2 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:26.727803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f3ea2c09-a4f4-43ab-9e5c-f5565e9986a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.736627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1026/2067] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:26.740925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.741212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.741482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.765104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e38e63-7353-40e7-942f-112606fc4828 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.766771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:26.768067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.769684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.770485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.770930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.771358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.773270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:26.780487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1027/2068] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:26.780487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.791209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315e1d2-535d-4c7b-9c0d-30df137e6c05 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.796586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.797306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.797717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.798219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.799209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:26.799617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.801318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.819685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1028/2069] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:26.823008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.840095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9390bc4-c664-4587-9b80-c70432bebc92 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.845386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:26.846518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.847472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.847883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.848251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.849270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:26.849675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.853175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.860800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.861957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.874194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1042/2070] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:26.875271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.888062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1029/2071] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:26.889331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980453c-4ca6-4c01-b7a5-c63c9ab89c38 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.893179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:26.896648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.897372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.897652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.897965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.898914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.901454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.919036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4588f-377d-452a-8a01-bfa86aaeb0cc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:26.934881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:26.935514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:26.935796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:26.936068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:26.936846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:26.943163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:26.944502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1043/2072] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:26.950150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.011957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1030/2073] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:27.016253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.132648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077036bf-3cd2-4e35-bb28-5fd80195185c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.160428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6546bb-b1b4-4be1-9d42-34a26be8e4c8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.167762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.168123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.168509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.168858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.169711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.171933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.204287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1031/2074] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:27 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:27.208551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.210673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.211970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.212285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.212595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.213284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.215438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.221764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfefd1-cf16-4b65-8530-f917b140b607 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.227778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.228767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.229233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.229604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.230551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.232649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.254662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1044/2075] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:26 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:27.256657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.257477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1032/2076] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:27.261646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.277942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501e65a-4e97-4d58-86aa-5c11d19beefb admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.281457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d0f6a-fa06-4f43-b30d-6e477f385a7f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.283880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.285311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.285699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.286306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.286835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.289750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.295339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.295969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.296232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.296499 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.297182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.298797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.302763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1033/2077] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:27.307593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.324869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1045/2078] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:27.326073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.328436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b807434-ebdd-415d-bcee-c38540212874 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.352566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe2f9f-9c9a-4f5f-8f6b-33e18434e5c9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.363982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.366925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.370161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.370576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] PATH_INFO: `/v3/projects/92ab8ec0a03f4354ac962e8fcb7d2de1/users/a581b2094e964dc0bbec27582ea503e4/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.380778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.381409 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.382600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.383050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.385068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.391914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.426154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ab8ec0a03f4354ac962e8fcb7d2de1, user_id=a581b2094e964dc0bbec27582ea503e4, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.429413 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c963e4-065f-443a-835d-0a802e779754 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.433612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1046/2079] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:27.438960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.463431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1034/2080] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:27 2022] PUT /identity/v3/projects/92ab8ec0a03f4354ac962e8fcb7d2de1/users/a581b2094e964dc0bbec27582ea503e4/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:27.465187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9162-00fd-4abc-b476-4c3728d2ddcc None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.465717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9162-00fd-4abc-b476-4c3728d2ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.466162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc9162-00fd-4abc-b476-4c3728d2ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.467928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d6608-2b50-4107-89bc-5db72813ec33 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.515142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-21cc9162-00fd-4abc-b476-4c3728d2ddcc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:27.522657 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-21cc9162-00fd-4abc-b476-4c3728d2ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:27.526287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:27.538851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:27.561073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.561855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.562162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.562642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] PATH_INFO: `/v3/projects/41befdcdeeef4632909073f687c5feac/users/ac04e49a8d344e00b890c537258b1ed7/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.584003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41befdcdeeef4632909073f687c5feac, user_id=ac04e49a8d344e00b890c537258b1ed7, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.589747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.610038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1035/2081] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:27.619399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1047/2082] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:27 2022] PUT /identity/v3/projects/41befdcdeeef4632909073f687c5feac/users/ac04e49a8d344e00b890c537258b1ed7/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:27.631480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.631861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.632229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.644069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.645904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:27.689582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] MFA Rules not processed for user `ac04e49a8d344e00b890c537258b1ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:27.690836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:27.767056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623515-fb12-4570-b587-11dc355f9e53 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.776065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.779245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.779245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.781153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.831030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1036/2083] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:27.837768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:27.878231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.881654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.917233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1048/2084] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:27.938021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1de5e0-f564-4eb6-bdf6-03ad9718ef16 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:27.944370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:27.945340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:27.946013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:27.946491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:27.947419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:27.949934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:27.987497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1037/2085] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:27 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:27.991905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.002692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2083337-7fa4-4ae3-be88-063e687c2c57 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.077041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.077653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.077971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.078248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.078902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.080960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.110799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1049/2086] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:27 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:28.112042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.125283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c0b8e-2fa9-44b4-8cf8-1c2e3c853ea5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.132665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.135020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.135020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.135020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.135403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.137269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.150813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1038/2087] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:28.155011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.162538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:28.168586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777cfe-4f4e-424a-af7a-7470749669eb admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.175918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.176987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.177868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.178352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] PATH_INFO: `/v3/projects/9afa671a5f45479887ba4688ece42026/users/c9bff6b2c5e84411bf3667077c4569ea/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.196745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afa671a5f45479887ba4688ece42026, user_id=c9bff6b2c5e84411bf3667077c4569ea, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.199891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.218464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1050/2088] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:28 2022] PUT /identity/v3/projects/9afa671a5f45479887ba4688ece42026/users/c9bff6b2c5e84411bf3667077c4569ea/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:28.220285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.232134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996087c2-bb90-4230-9793-419ab4757945 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.265313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:28.340599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.341691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.342411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.342816 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.343911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.345863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f706-3b69-40d8-8a9b-183524b34909 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.362032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1039/2089] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:28.366034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.382835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a12b0-c106-4a9e-a9d7-2a2989e06089 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.398776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.399776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.400297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.400675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] PATH_INFO: `/v3/projects/9afa671a5f45479887ba4688ece42026/users/c9bff6b2c5e84411bf3667077c4569ea/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.403029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afa671a5f45479887ba4688ece42026, user_id=c9bff6b2c5e84411bf3667077c4569ea, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.406586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.440169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1051/2090] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:28 2022] PUT /identity/v3/projects/9afa671a5f45479887ba4688ece42026/users/c9bff6b2c5e84411bf3667077c4569ea/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:28.441164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.441807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.442292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.488949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] MFA Rules not processed for user `c9bff6b2c5e84411bf3667077c4569ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:28.490488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:28.589875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1040/2091] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:28.635134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.704201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6665-b246-481a-86bf-50624daf6ab1 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.715268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.715898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.716178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.716453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:28.733048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:28.734505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:28.749949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1052/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:28.833502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:28.873671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5de95-2b78-4477-8cc1-aa72c3d1ad51 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:28.888376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:28.891220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:28.892698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:28.894070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:29.002582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:29.004038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:29.015775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1041/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:33.075712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:33.079614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:33.222700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a204d-1f3d-4105-89c3-d3671fe1bf6d service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:33.233975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:33.234623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.234904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.235182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] PATH_INFO: `/v3/users/51058e9a0e884a939bad12fa4ba659bf` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:33.238617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51058e9a0e884a939bad12fa4ba659bf)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:33.244298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:33.408180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51058e9a0e884a939bad12fa4ba659bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.432433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51058e9a0e884a939bad12fa4ba659bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.433123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51058e9a0e884a939bad12fa4ba659bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.433872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51058e9a0e884a939bad12fa4ba659bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.462137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-497c45fc-5dc7-4937-8088-af173b12cf63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51058e9a0e884a939bad12fa4ba659bf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.463889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:33.466987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:33.485942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdda0-990a-4e24-9be4-56687f56bbac service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:33.494578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1053/2094] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:33 2022] DELETE /identity/v3/users/51058e9a0e884a939bad12fa4ba659bf => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:33.496875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.497309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.497748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:33.507773 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:33.508462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.508735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.508995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] PATH_INFO: `/v3/users/ac04e49a8d344e00b890c537258b1ed7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:33.511143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac04e49a8d344e00b890c537258b1ed7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:33.513129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:33.524430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:33.525911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:33.633474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:33.673327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac04e49a8d344e00b890c537258b1ed7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.690866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac04e49a8d344e00b890c537258b1ed7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.712974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac04e49a8d344e00b890c537258b1ed7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.714249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac04e49a8d344e00b890c537258b1ed7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.715199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b21a84e1-2da8-48ba-b335-1a69ae04f59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac04e49a8d344e00b890c537258b1ed7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:33.728245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1054/2095] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:33.741607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:33.746198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1042/2096] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:33 2022] DELETE /identity/v3/users/ac04e49a8d344e00b890c537258b1ed7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:33.752072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:33.759212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.759673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.760082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:33.812644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:33.813954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:33.876197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b96d8c-0907-4544-800d-ac3dd239a133 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:33.950622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:33.951125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.951454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.951764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:33.956316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1043/2097] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:33.964624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:33.966226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:33.969049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:33.977582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1055/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:33.983414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cca04b-2cd8-49ac-bfcc-3ae0d8cbf41a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:33.987586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:33.988207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:33.988484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:33.988751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:34.002805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:34.004402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:34.017482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1044/2099] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:34.840244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:34.843620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:34.882781 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa243b-1ddf-4556-a7c4-ee54f09d330a service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:34.903772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:34.904761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:34.905395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:34.905873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] PATH_INFO: `/v3/projects/41befdcdeeef4632909073f687c5feac` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:34.907754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41befdcdeeef4632909073f687c5feac)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:34.910187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:35.029937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:35.040072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41befdcdeeef4632909073f687c5feac', 'request_id': 'req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.048887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41befdcdeeef4632909073f687c5feac', 'request_id': 'req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.060004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41befdcdeeef4632909073f687c5feac', 'request_id': 'req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.072824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:35.074541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:35.088215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] The token cache is being invalidate because project 41befdcdeeef4632909073f687c5feac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:35.088215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.088215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.092522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1056/2100] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:34 2022] DELETE /identity/v3/projects/41befdcdeeef4632909073f687c5feac => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:35.094010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed03cc-e08b-4071-a4af-211a6e36b7b3 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:35.096766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:35.103203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:35.225931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb963e-aa36-4eb1-b011-a465d29f4a9b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:35.237847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:35.240059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:35.240356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:35.240635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] PATH_INFO: `/v3/users/c9bff6b2c5e84411bf3667077c4569ea` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:35.244362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bff6b2c5e84411bf3667077c4569ea)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:35.249189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:35.259311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:35.259964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:35.260245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:35.260521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] PATH_INFO: `/v3/projects/5637509fcb254ccab343d6c1db704a49` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:35.261684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5637509fcb254ccab343d6c1db704a49)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:35.263644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:35.348350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bff6b2c5e84411bf3667077c4569ea'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.362803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bff6b2c5e84411bf3667077c4569ea'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.363802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bff6b2c5e84411bf3667077c4569ea'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.364614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bff6b2c5e84411bf3667077c4569ea'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.367294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:35.383164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5637509fcb254ccab343d6c1db704a49', 'request_id': 'req-f86ffefa-cb65-4611-b066-a342a07491a4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.396708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bff6b2c5e84411bf3667077c4569ea'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.410268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5637509fcb254ccab343d6c1db704a49', 'request_id': 'req-f86ffefa-cb65-4611-b066-a342a07491a4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.417867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1057/2101] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:35 2022] DELETE /identity/v3/users/c9bff6b2c5e84411bf3667077c4569ea => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:35.424754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5637509fcb254ccab343d6c1db704a49', 'request_id': 'req-f86ffefa-cb65-4611-b066-a342a07491a4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.457017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] The token cache is being invalidate because project 5637509fcb254ccab343d6c1db704a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:35.457586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.458581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f86ffefa-cb65-4611-b066-a342a07491a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.461097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1045/2102] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:35 2022] DELETE /identity/v3/projects/5637509fcb254ccab343d6c1db704a49 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:35.467053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:35.470646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:35.615331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:35.677656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dc9e3-890e-4ad2-bb1c-1f2061da13a3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:35.712113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:35.712776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:35.713059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:35.713337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] PATH_INFO: `/v3/users/474437b44ebc41919618faa6b68abec2` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:35.720003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474437b44ebc41919618faa6b68abec2)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:35.722615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:35.839088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474437b44ebc41919618faa6b68abec2'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.853193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474437b44ebc41919618faa6b68abec2'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.854008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474437b44ebc41919618faa6b68abec2'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.854590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474437b44ebc41919618faa6b68abec2'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.880014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474437b44ebc41919618faa6b68abec2'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:35.909594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:35.909949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:35.910182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:35.911682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1058/2103] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:35 2022] DELETE /identity/v3/users/474437b44ebc41919618faa6b68abec2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:35.952728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] MFA Rules not processed for user `a581b2094e964dc0bbec27582ea503e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:35.954155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:36.117532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1046/2104] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:36.119756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.122101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:36.246868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92976a-d06b-4179-833d-dac062e1fe47 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.252509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.253272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.253594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.253979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.255092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.260687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.295719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1059/2105] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:36 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:36.299633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.317399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a8982-1ecb-42ad-b31e-95268443820a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.393956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.395059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.395679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.395679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.397171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.399050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.429233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1047/2106] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:36 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:36.434058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.447125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6410a-cd8f-4221-a8dc-c10b102b02cb admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.455781 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.457765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.457947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.458107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.460330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.477694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.490268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1060/2107] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:36.495068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.506378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13813407-b1a6-47ed-9388-af6c3bdbb95d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.511677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.512522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.512810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.513087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] PATH_INFO: `/v3/projects/9bc836967f624e33b02b062e01fc42b4/users/f18c129934cd42a08f86f3cebbbf583c/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.541092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc836967f624e33b02b062e01fc42b4, user_id=f18c129934cd42a08f86f3cebbbf583c, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.544494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.553032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.555836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:36.564523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1048/2108] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:36 2022] PUT /identity/v3/projects/9bc836967f624e33b02b062e01fc42b4/users/f18c129934cd42a08f86f3cebbbf583c/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:36.569304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.571154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:36.586398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a0c19-a2ff-497e-86f4-92dbb76a5140 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.623585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:36.676770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:36.683150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9fce9-56f5-4d7c-b692-8739540d1933 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:36.688493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.689355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.689591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.690071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] PATH_INFO: `/v3/projects/dfe180643a2c4f1e9c7051429984f58a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.691770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe180643a2c4f1e9c7051429984f58a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.693571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.717756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:36.719249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.719761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.720676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] PATH_INFO: `/v3/projects/9afa671a5f45479887ba4688ece42026` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.722254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afa671a5f45479887ba4688ece42026)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:36.725424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:36.760478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe180643a2c4f1e9c7051429984f58a', 'request_id': 'req-dc676854-39c6-47cd-870e-c0029d94c346'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.772085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe180643a2c4f1e9c7051429984f58a', 'request_id': 'req-dc676854-39c6-47cd-870e-c0029d94c346'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.788724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe180643a2c4f1e9c7051429984f58a', 'request_id': 'req-dc676854-39c6-47cd-870e-c0029d94c346'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.823189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afa671a5f45479887ba4688ece42026', 'request_id': 'req-04144c59-fe78-477a-8735-433b4cafa5bd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.830663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afa671a5f45479887ba4688ece42026', 'request_id': 'req-04144c59-fe78-477a-8735-433b4cafa5bd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.835466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] The token cache is being invalidate because project dfe180643a2c4f1e9c7051429984f58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:36.836780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.838419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.842445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1049/2109] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:36 2022] DELETE /identity/v3/projects/dfe180643a2c4f1e9c7051429984f58a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:36.845306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:36.847278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afa671a5f45479887ba4688ece42026', 'request_id': 'req-04144c59-fe78-477a-8735-433b4cafa5bd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.849440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:36.872631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] The token cache is being invalidate because project 9afa671a5f45479887ba4688ece42026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:36.873228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.874199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-04144c59-fe78-477a-8735-433b4cafa5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:36.881880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1061/2110] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:36 2022] DELETE /identity/v3/projects/9afa671a5f45479887ba4688ece42026 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:36.881880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427499-884e-4606-b422-7bf20e4c0eeb None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:36.882606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427499-884e-4606-b422-7bf20e4c0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:36.883947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93427499-884e-4606-b422-7bf20e4c0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:36.928764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-93427499-884e-4606-b422-7bf20e4c0eeb None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:36.932135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-93427499-884e-4606-b422-7bf20e4c0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.005665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1062/2111] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:37.014320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.014642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.014922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.016572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc676854-39c6-47cd-870e-c0029d94c346 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.021257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.021903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.022198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.022452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.023095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.025944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64d803-41e4-4e8d-bc89-bdcdfbf54f69 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.039900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1050/2112] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:37.041260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d1beb-9e39-4d5d-8a16-1545046f355a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.041545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d1beb-9e39-4d5d-8a16-1545046f355a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.041838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d1beb-9e39-4d5d-8a16-1545046f355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.050197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:37.051423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.061764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1063/2113] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:37.063626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.065303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.073197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b39d1beb-9e39-4d5d-8a16-1545046f355a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:37.074867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b39d1beb-9e39-4d5d-8a16-1545046f355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.080392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a520047-b8d0-4af3-8606-a55785ebb6fc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.085217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.088649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.088649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.088649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] PATH_INFO: `/v3/projects/9bc836967f624e33b02b062e01fc42b4/users/f18c129934cd42a08f86f3cebbbf583c/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.088933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc836967f624e33b02b062e01fc42b4, user_id=f18c129934cd42a08f86f3cebbbf583c, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.089863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1051/2114] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:37.091427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.091681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.092146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.092638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.103507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1064/2115] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:37 2022] PUT /identity/v3/projects/9bc836967f624e33b02b062e01fc42b4/users/f18c129934cd42a08f86f3cebbbf583c/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:37.104251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.120095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:37.122152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.179769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:37.213863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1052/2116] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:37.218549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.232388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:37.234808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e63d9-3473-4de2-991f-cbe6e2578473 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.249585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0636a4-8b5e-42a3-8074-f5d3347ec6d5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.253406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.254077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.254373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.254634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.255316 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:37.255661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.258216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.269788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.269788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.270099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.270757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.270986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:37.271283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.273064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.290382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1053/2117] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:38:37.294078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1065/2118] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:37.295137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.299608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.310127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7a0c4-da4e-4d71-9486-b02b48093d0c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.314498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780284-9e1c-4424-b447-fde516f3272f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.316628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.317805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.318736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.320661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.321760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.324259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.325754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.326378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.326652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.326915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.327530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.330214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.366310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1054/2119] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:37.370667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.374936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1066/2120] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:37.376286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.473718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8507281-a629-45ca-ac86-205e88cde9af admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.508887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f34bf-5790-4d13-97db-a5770df40086 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.522008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.523095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.523959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.524238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.524885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.527279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.561698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1067/2121] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:37.563166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.582940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31dd2-c5ac-470e-a274-44aed4b60382 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.596015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.596507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.596635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.596927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.597128 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.597257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.597435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.597664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.597931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.599771 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.608017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.610034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.614153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1068/2122] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:37.618900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.630924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd124f-5248-4f18-84b6-1d81ff1bb511 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.638093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.638832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.639118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.639393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.640045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.642456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.662919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1055/2123] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/users => generated 292 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:37.666253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1069/2124] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:37.666982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.667446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.688496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff61865-b262-4c1c-9586-b846ca5e6cb8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.690010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd8371-79f6-4be4-9576-c3e2859f4082 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.698301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.698696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.699075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.699349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.700075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.701765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.705050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.705852 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.706221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.706605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] PATH_INFO: `/v3/projects/d33ad68fd93e42aa926a97104104abdf/users/24f6a08803004299b2e7a72a4266279f/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.713768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1070/2125] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:37.717712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.726992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33ad68fd93e42aa926a97104104abdf, user_id=24f6a08803004299b2e7a72a4266279f, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.730187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281b87-0e2a-420a-acf2-457a7fd96c77 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.732135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d4bd9-258b-4bab-abf7-afb2850fa749 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.738264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.738936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.739220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.739482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.740166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.741828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.761851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1071/2127] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:37.761851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:37.763265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1056/2127] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:37 2022] PUT /identity/v3/projects/d33ad68fd93e42aa926a97104104abdf/users/24f6a08803004299b2e7a72a4266279f/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:37.768049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.768616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.769141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.785413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22163529-8d9f-48c6-8874-65f55b0e2050 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:37.834998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] MFA Rules not processed for user `24f6a08803004299b2e7a72a4266279f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:37.836807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:37.872759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:37.927421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:37.928851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:37.930311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:37.930826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] PATH_INFO: `/v3/projects/13c55dc6f58c4badb63c96f415a471fc/users/b874f92ddf574bbcb21a2ec98618ef60/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:37.973341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c55dc6f58c4badb63c96f415a471fc, user_id=b874f92ddf574bbcb21a2ec98618ef60, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:37.982081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff0107-95d7-4ca4-a914-e3c3a75bf774 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:37.989695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:38.011136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1072/2128] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:37 2022] PUT /identity/v3/projects/13c55dc6f58c4badb63c96f415a471fc/users/b874f92ddf574bbcb21a2ec98618ef60/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:38.015822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1057/2129] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:38.029794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.032473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.032793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.036652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:38.038130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:38.093811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] MFA Rules not processed for user `b874f92ddf574bbcb21a2ec98618ef60`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:38.095063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:38.128846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebf551-fe26-4730-a2c2-b48d3bb697a6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:38.203452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:38.204398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.204859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.205197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.244274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1073/2130] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:38.250292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:38.328594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:38.330518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:38.357970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1058/2131] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:38.381665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:38.403834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030f6c1-029f-467c-afff-946a16801f33 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:38.419611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:38.423036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.423818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.424704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.426552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:38.431468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:38.436542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:38.499694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1074/2132] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:38 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:38.504138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:38.592706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30ece4-9ba1-4c77-9f11-8be898f5a084 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:38.775337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c590-d7d2-4bf0-b194-3ee71e28bcaf admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:38.796182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:38.797417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.797703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.798486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] PATH_INFO: `/v3/users/24f6a08803004299b2e7a72a4266279f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.801158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f6a08803004299b2e7a72a4266279f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:38.803663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:38.809678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:38.810147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.810363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.810644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.811738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:38.814148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:38.877194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:38.898028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1075/2133] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:38 2022] POST /identity/v3/users => generated 297 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:38.901162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:38.931078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf90168-9ad0-4bb7-b115-16fea0abe03e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:38.931955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f6a08803004299b2e7a72a4266279f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:38.948785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:38.949187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f6a08803004299b2e7a72a4266279f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:38.949659 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:38.951025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:38.952528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:38.956502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:38.961856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:38.974753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f6a08803004299b2e7a72a4266279f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:38.976027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f6a08803004299b2e7a72a4266279f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:38.977558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-46d27013-f655-454e-8b31-e9f00442251d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f6a08803004299b2e7a72a4266279f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:39.000627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1076/2134] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:39.004851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:39.007726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:39.014511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1059/2135] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:38 2022] DELETE /identity/v3/users/24f6a08803004299b2e7a72a4266279f => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:39.019183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.020626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.021006 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.037248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a0fdc-9032-467a-878c-2236cf5c9c0a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:39.086900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:39.088470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:39.187456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:39.188814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.189305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.189941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] PATH_INFO: `/v3/projects/1589a32731204c408d7bc44500370359/users/6f575f1a0e814c7890ccc009aca06bc3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.215915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:39.228140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1589a32731204c408d7bc44500370359, user_id=6f575f1a0e814c7890ccc009aca06bc3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:39.237442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:39.254671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1060/2136] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:39.269709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:39.271285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:39.275728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1077/2137] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:39 2022] PUT /identity/v3/projects/1589a32731204c408d7bc44500370359/users/6f575f1a0e814c7890ccc009aca06bc3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:39.277202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:39.417320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e1f2-099b-4845-bda5-03023d19edf2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:39.418457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3be7-11b6-40bf-9f05-fbf0151e8ae0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:39.432767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:39.433396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.433674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.433974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.434631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:39.436698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:39.462948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1078/2138] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:39.464574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:39.485034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b305-63a4-44ee-9d1a-b62df81aa57f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:39.502969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:39.503658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.504752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.504752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] PATH_INFO: `/v3/projects/1589a32731204c408d7bc44500370359/users/6f575f1a0e814c7890ccc009aca06bc3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.506373 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1589a32731204c408d7bc44500370359, user_id=6f575f1a0e814c7890ccc009aca06bc3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:39.509628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67749cd-dfba-431a-85df-8e388748fcfa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:39.536815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:39.537453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.545864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.546093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1079/2139] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:39 2022] PUT /identity/v3/projects/1589a32731204c408d7bc44500370359/users/6f575f1a0e814c7890ccc009aca06bc3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:39.546198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.549016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:39.549309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:39.549582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:39.562441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:39.563993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:39.600601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1061/2140] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:39.605684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] MFA Rules not processed for user `6f575f1a0e814c7890ccc009aca06bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:39.607905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:39.698520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:39.784385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1080/2141] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:39.792191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:39.793574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:39.923415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906be57-5239-4c23-b86c-e04b0090e59d service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:40.087187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:40.089346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:40.089757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:40.091199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:40.118777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:40.136884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:40.165755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1062/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:40.384545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:40.410856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37330a1b-c177-4981-97d6-7ae8852b821d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:40.428152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:40.431937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:40.432517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:40.432998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:40.440086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:40.662224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:40.666086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fcdd2-5ae0-4b4a-afb0-98c3a43368e3 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:40.709777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1081/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:40.991470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:40.994019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:41.010788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:41.096500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3838e-0324-47d9-af3c-4b4d52434da2 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.108652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.109418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.109777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.110121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] PATH_INFO: `/v3/projects/d33ad68fd93e42aa926a97104104abdf` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.112411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33ad68fd93e42aa926a97104104abdf)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.114854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:41.215813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33ad68fd93e42aa926a97104104abdf', 'request_id': 'req-b7e88c93-8aee-469d-af37-235e4fc26e40'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:41.231013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33ad68fd93e42aa926a97104104abdf', 'request_id': 'req-b7e88c93-8aee-469d-af37-235e4fc26e40'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:41.243883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33ad68fd93e42aa926a97104104abdf', 'request_id': 'req-b7e88c93-8aee-469d-af37-235e4fc26e40'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:41.276695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] The token cache is being invalidate because project d33ad68fd93e42aa926a97104104abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:41.278020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:41.280789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b7e88c93-8aee-469d-af37-235e4fc26e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:41.284876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1063/2144] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:40 2022] DELETE /identity/v3/projects/d33ad68fd93e42aa926a97104104abdf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:41.290646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.290964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.291205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.331028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:41.332748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:41.446282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1082/2145] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:41.448070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.448357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.448630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.499962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:41.502236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:41.522811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1064/2146] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:41.523057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:41.543393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa67d9-1e57-4750-8ac7-db7c6f425d2e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.553991 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.554776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.555128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.555400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.556268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:41.569393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.574428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:41.604267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1083/2147] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:41.608828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:41.624189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875b389-c9cc-48c1-9f8a-733372675b76 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.635162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.635864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.636235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.636577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.637327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.639601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:41.719116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1065/2148] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:41 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:41.719713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:41.738629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488237f-7f6b-44b9-9af7-ef9948e3caa1 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.850527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.852370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.852370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.852370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.852370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.854472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:41.882171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:41.902269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1084/2149] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:41 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:41.904416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:41.921057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d70a0a-b33e-493c-9311-2add818c2cd5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.938389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.939481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.940247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.940716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.941671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.943654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:41.959851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1066/2150] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:41.964041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:41.985280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4aea8-4c2e-4bec-a0f1-b0bbb310cab4 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:41.993670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:41.994330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:41.994609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:41.994934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:41.995946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:41.997577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b207-0e05-411c-85e9-f19396d085f8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:42.018667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1085/2151] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:42.023210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:42.040700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df96a6-e51c-420c-9c4e-9097d5aa2ab4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:42.047515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:42.048644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.050024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.050536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] PATH_INFO: `/v3/projects/e47a349924da4fce9b3f97ff3e07d6c8/users/81e53fbd41f446fa9e3ab134590552e0/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.076269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47a349924da4fce9b3f97ff3e07d6c8, user_id=81e53fbd41f446fa9e3ab134590552e0, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:42.079853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:42.100681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1067/2152] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:42 2022] PUT /identity/v3/projects/e47a349924da4fce9b3f97ff3e07d6c8/users/81e53fbd41f446fa9e3ab134590552e0/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:42.113622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.114087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.114372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.174426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] MFA Rules not processed for user `81e53fbd41f446fa9e3ab134590552e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:42.176571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:42.204822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:42.208130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:42.256806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1086/2153] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:42.257264 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:42.269214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:42.272844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:42.307983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53d54-53f4-4205-a95f-219e8b84e789 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:42.317460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:42.318402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.318842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.319214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.326589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:42.396082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903038f4-74b1-4946-af0b-cb0965e369dd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:42.404527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:42.405641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.406675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.407052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.426625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:42.429691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:42.448741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:42.450652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68bc17-505f-4df1-93df-feba069a5748 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:42.452861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1087/2154] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:42.466004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1068/2155] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:42.497243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:42.665621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650c950-5ea5-4fbe-ab6c-61f1bbc306f8 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:42.680956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:42.681611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.682206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.682482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] PATH_INFO: `/v3/users/81e53fbd41f446fa9e3ab134590552e0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.694215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e53fbd41f446fa9e3ab134590552e0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:42.699061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:42.739868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:42.806173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e53fbd41f446fa9e3ab134590552e0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:42.821855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e53fbd41f446fa9e3ab134590552e0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:42.822725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e53fbd41f446fa9e3ab134590552e0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:42.839235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e53fbd41f446fa9e3ab134590552e0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:42.881894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e53fbd41f446fa9e3ab134590552e0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:42.910312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1088/2156] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:42 2022] DELETE /identity/v3/users/81e53fbd41f446fa9e3ab134590552e0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:42.915283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5418-7b9c-47b1-9e91-2ba39533b66e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:42.915573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5418-7b9c-47b1-9e91-2ba39533b66e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:42.916231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae5418-7b9c-47b1-9e91-2ba39533b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:42.946842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5cae5418-7b9c-47b1-9e91-2ba39533b66e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:42.949191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5cae5418-7b9c-47b1-9e91-2ba39533b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.028330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1069/2157] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:43.037104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:43.038614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.110486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdfe43-bde6-44c7-bb29-f9de616b651d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:43.119594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:43.120305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.120482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.120752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.132984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:43.135775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c3b9b-cd4a-46dc-9d8a-962d7bb63860 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:43.188394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1089/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:43.299099 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.299382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.299846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.301967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1070/2159] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:38:43.360195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f58f-9023-4190-963d-6cfb2fe22a60 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.360490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f58f-9023-4190-963d-6cfb2fe22a60 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.360761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f58f-9023-4190-963d-6cfb2fe22a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.400517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-60c6f58f-9023-4190-963d-6cfb2fe22a60 None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:43.402169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-60c6f58f-9023-4190-963d-6cfb2fe22a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.452465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:43.454858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.487133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36a847-1546-4698-8a83-c2617a67fee5 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:43.496694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:43.498299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.498750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.499169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] PATH_INFO: `/v3/users/c5644c1fa3a94940970e29828bbdf29c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.501042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5644c1fa3a94940970e29828bbdf29c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:43.503500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:43.593920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1090/2160] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:43.599712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea343aec-6a94-43e6-8819-d2222085b271 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.600820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea343aec-6a94-43e6-8819-d2222085b271 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.601204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea343aec-6a94-43e6-8819-d2222085b271 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.606529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1091/2161] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 12 15:38:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:38:43.608964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5644c1fa3a94940970e29828bbdf29c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:43.610450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.610774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.611051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.634699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5644c1fa3a94940970e29828bbdf29c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:43.661436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] MFA Rules not processed for user `124f41a738ee4b998ecddc566b09d78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:43.662936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.672322 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5644c1fa3a94940970e29828bbdf29c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:43.675320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5644c1fa3a94940970e29828bbdf29c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:43.680289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5644c1fa3a94940970e29828bbdf29c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:43.684029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1092/2162] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 12 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:43.693831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:43.694465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:43.724980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d586988-f7c8-41f2-8607-0786ab799abe None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:43.738261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1071/2163] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:43 2022] DELETE /identity/v3/users/c5644c1fa3a94940970e29828bbdf29c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:43.747625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:43.750840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:43.751210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:43.751549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:43.759073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.775577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:43.777622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:43.791178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1093/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:43.940279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:43.941717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:43.980314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:43.981883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.015597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624326b-102f-4f70-b010-8956e1e19c5f service placement] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.037586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:44.105970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fde3d5-1c16-4f85-a43e-8b3fac5b1a4c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.113277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.114408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.115515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.116184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] PATH_INFO: `/v3/users/b874f92ddf574bbcb21a2ec98618ef60` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.118524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b874f92ddf574bbcb21a2ec98618ef60)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.121414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.123440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b3775-e598-4108-949d-f693b036885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.124937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3775-e598-4108-949d-f693b036885e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.125228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3775-e598-4108-949d-f693b036885e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.125501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3775-e598-4108-949d-f693b036885e admin admin] PATH_INFO: `/v3/projects/a12501fa6db34b788ff67e4c45151ba0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.127011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b3775-e598-4108-949d-f693b036885e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12501fa6db34b788ff67e4c45151ba0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.129722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b3775-e598-4108-949d-f693b036885e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.197506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b874f92ddf574bbcb21a2ec98618ef60'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.208773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12501fa6db34b788ff67e4c45151ba0', 'request_id': 'req-919b3775-e598-4108-949d-f693b036885e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.216277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b874f92ddf574bbcb21a2ec98618ef60'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.219274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12501fa6db34b788ff67e4c45151ba0', 'request_id': 'req-919b3775-e598-4108-949d-f693b036885e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.231678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12501fa6db34b788ff67e4c45151ba0', 'request_id': 'req-919b3775-e598-4108-949d-f693b036885e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.238980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b874f92ddf574bbcb21a2ec98618ef60'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.239702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b874f92ddf574bbcb21a2ec98618ef60'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.240306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ec1dc0eb-f4e0-4bf8-8c6f-687d04386bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b874f92ddf574bbcb21a2ec98618ef60'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.262125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] The token cache is being invalidate because project a12501fa6db34b788ff67e4c45151ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:44.262433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.264290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-919b3775-e598-4108-949d-f693b036885e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.269265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1094/2165] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:43 2022] DELETE /identity/v3/projects/a12501fa6db34b788ff67e4c45151ba0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:44.270711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.270995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.271271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.276422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1072/2166] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:43 2022] DELETE /identity/v3/users/b874f92ddf574bbcb21a2ec98618ef60 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:44.278327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8db77-073b-4510-9334-570a5c52815b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.278831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8db77-073b-4510-9334-570a5c52815b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.279388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8db77-073b-4510-9334-570a5c52815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.302159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:44.303679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.318902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-53e8db77-073b-4510-9334-570a5c52815b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:44.320540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-53e8db77-073b-4510-9334-570a5c52815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.385328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1095/2167] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:44.386352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:44.389552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.403096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef7d18-dd51-4f7d-86c8-177cd163e927 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.405806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1073/2168] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:44.410187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.410542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.410872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.418055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.418755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.419152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.419845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] PATH_INFO: `/v3/projects/e47a349924da4fce9b3f97ff3e07d6c8` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.421041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47a349924da4fce9b3f97ff3e07d6c8)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.423011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.437185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:44.438729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.458668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1074/2169] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:44.463733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:44.466740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.494336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:44.496298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:44.511772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47a349924da4fce9b3f97ff3e07d6c8', 'request_id': 'req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.522831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47a349924da4fce9b3f97ff3e07d6c8', 'request_id': 'req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.542995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47a349924da4fce9b3f97ff3e07d6c8', 'request_id': 'req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.569234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] The token cache is being invalidate because project e47a349924da4fce9b3f97ff3e07d6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:44.570482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.573774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:44.574419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974811a-0b5b-4fec-b97e-54a6a83534f7 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.577298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1096/2170] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:44 2022] DELETE /identity/v3/projects/e47a349924da4fce9b3f97ff3e07d6c8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:44.578374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:44.582648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.740679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ff66-68dd-4aef-bf19-0a2347b2acbd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.749259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.749944 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.750231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.750576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.751259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:44.751574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.755774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.774366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1097/2171] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:44.774864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.775234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.775515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.775788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.777340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:44.779417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:44.794888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.796343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.802877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b2828-8678-44c6-aea4-443a0a3481f9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.809213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.809866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.810142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.810410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.811158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.813149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:44.818105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1075/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:44.847473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1098/2173] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:44 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:44.850889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:44.864193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df4af-d2d7-4691-8f9b-be66cd0deade service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:44.966326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:44.967135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:44.967915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:44.968312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:44.968967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:44.971890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.020798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1076/2174] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:44 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:45.021956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.035438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f44e-9a85-46e2-b2a7-b83fe064447b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.040916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.041545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.041856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.042133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.042865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.044480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.059673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1099/2175] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:45.061280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.074248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5512b-bdce-483d-933d-34dc6c31fa4f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.079922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.081902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.082217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.082550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.083494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.087210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6bbda-b009-4d6c-858a-5fd1f96371d0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.106536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1077/2176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:45.107999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.132426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c6457-679f-4869-b716-93a37dd0f530 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.144004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.144682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.145056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.145442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] PATH_INFO: `/v3/projects/114306e05da04bbca23fdcfe56c21a04/users/5eaf5f7717e048018cd9696f88d22f9c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.165856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114306e05da04bbca23fdcfe56c21a04, user_id=5eaf5f7717e048018cd9696f88d22f9c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.169603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.192656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1100/2177] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:45 2022] PUT /identity/v3/projects/114306e05da04bbca23fdcfe56c21a04/users/5eaf5f7717e048018cd9696f88d22f9c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:45.205167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.205499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.205915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.241049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] MFA Rules not processed for user `5eaf5f7717e048018cd9696f88d22f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:45.242844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:45.340054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:45.400588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1078/2178] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:45.404787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.446220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.448593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:45.491055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a3e09-7eb7-4401-bd65-ceb275859b55 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.500899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.501866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.502432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.503610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.504842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.508686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.527467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:45.557447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1101/2179] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:45 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:45.561702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.576479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907372-addc-4aab-9f4e-0d1166a87f04 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.662785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.664617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.664901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.665175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] PATH_INFO: `/v3/projects/13c55dc6f58c4badb63c96f415a471fc` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.667140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c55dc6f58c4badb63c96f415a471fc)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.669221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.713686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfe51-db02-40df-b00b-52e74aa58c35 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.723296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.723841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.724123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.724394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.725034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.728279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.732665 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c55dc6f58c4badb63c96f415a471fc', 'request_id': 'req-d310877e-ec43-4fee-befa-c854a4f314ef'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:45.744282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c55dc6f58c4badb63c96f415a471fc', 'request_id': 'req-d310877e-ec43-4fee-befa-c854a4f314ef'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:45.754074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c55dc6f58c4badb63c96f415a471fc', 'request_id': 'req-d310877e-ec43-4fee-befa-c854a4f314ef'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:45.763954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1102/2180] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:45 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:45.766110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.772529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] The token cache is being invalidate because project 13c55dc6f58c4badb63c96f415a471fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:45.773626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:45.774536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:45.776623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1079/2181] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:45 2022] DELETE /identity/v3/projects/13c55dc6f58c4badb63c96f415a471fc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:45.780098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.781843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:45.781983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605647-e34a-43c5-92ab-4d6f21b770d5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.806029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:45.868738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.869684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.870287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.870287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.871131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.874517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.896387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1103/2182] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:45.901038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:45.906328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:45.912847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310877e-ec43-4fee-befa-c854a4f314ef admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.919325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.919962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.920246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.921020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] PATH_INFO: `/v3/users/6f575f1a0e814c7890ccc009aca06bc3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.922910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f575f1a0e814c7890ccc009aca06bc3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.925021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:45.935838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673844e4-df94-458d-a62a-c2f97131bfdc admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:45.943348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:45.947017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:45.947017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:45.947017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] PATH_INFO: `/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69/users/d9f996da4644446e9c6200942f392a26/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:45.972298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4499b8f4b84b3bb133bd9e76f18e69, user_id=d9f996da4644446e9c6200942f392a26, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:45.983618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:46.025605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1104/2183] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:45 2022] PUT /identity/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69/users/d9f996da4644446e9c6200942f392a26/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:46.026684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:46.040620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f575f1a0e814c7890ccc009aca06bc3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.052242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f575f1a0e814c7890ccc009aca06bc3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.065204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f575f1a0e814c7890ccc009aca06bc3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.065979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f575f1a0e814c7890ccc009aca06bc3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.066643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f575f1a0e814c7890ccc009aca06bc3'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.090902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1080/2184] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:45 2022] DELETE /identity/v3/users/6f575f1a0e814c7890ccc009aca06bc3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:46.115632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:46.131244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462794ab-ee65-4e19-91dc-fa8035d56b13 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:46.234141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:46.234931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.235310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.235572 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:46.236252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:46.238937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e30b6-4cda-4170-b0c2-fc2f6e6eb207 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:46.257920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1105/2185] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:46.262331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:46.264146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:46.290523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0be5b4-1b7d-4fee-ab79-41b30a036d3e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:46.295786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:46.296699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.297133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.297555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] PATH_INFO: `/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69/users/d9f996da4644446e9c6200942f392a26/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:46.300393 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4499b8f4b84b3bb133bd9e76f18e69, user_id=d9f996da4644446e9c6200942f392a26, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:46.303309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:46.331323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1081/2186] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:46 2022] PUT /identity/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69/users/d9f996da4644446e9c6200942f392a26/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:46.344157 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.344482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.345024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:46.410335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] MFA Rules not processed for user `d9f996da4644446e9c6200942f392a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:46.411602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:46.521565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1106/2187] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:46.538167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:46.542135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:46.580380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:46.582068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:46.748348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1f1b-b357-4009-81ab-733c597027fc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:46.756834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:46.756834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.756834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.756834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:46.770268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5f20-2e1e-4f4d-a507-df98b73113a6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:46.772255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:46.774545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784882a4-bb49-4f09-b24e-a282e5b766e8 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:46.786625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1082/2188] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:46.800414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:46.801607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.804162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.806195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] PATH_INFO: `/v3/projects/1589a32731204c408d7bc44500370359` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:46.809006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1589a32731204c408d7bc44500370359)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:46.816451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:46.871356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:46.918965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1589a32731204c408d7bc44500370359', 'request_id': 'req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.930451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1589a32731204c408d7bc44500370359', 'request_id': 'req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.946859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1589a32731204c408d7bc44500370359', 'request_id': 'req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.965668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] The token cache is being invalidate because project 1589a32731204c408d7bc44500370359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:46.966121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.966902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d4ffeadd-6bbc-4c1b-9cb3-88a461bfc812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:46.972118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1107/2189] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:46 2022] DELETE /identity/v3/projects/1589a32731204c408d7bc44500370359 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:46.974634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e24f-52ee-4e00-a74f-5cb0938ee686 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:46.974849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e24f-52ee-4e00-a74f-5cb0938ee686 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:46.975367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409e24f-52ee-4e00-a74f-5cb0938ee686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.045379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7409e24f-52ee-4e00-a74f-5cb0938ee686 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:47.046229 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7409e24f-52ee-4e00-a74f-5cb0938ee686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.100762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:47.192648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.193657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.194214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.194501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1083/2190] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:47.196545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.197036 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.197445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.240562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:47.241959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.250824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1084/2191] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:47.255031 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.266986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb290d58-efed-4a66-84d5-241e38a2065d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.275470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.276400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.276828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.277356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.278280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:47.278769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.281875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.292456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] MFA Rules not processed for user `f18c129934cd42a08f86f3cebbbf583c`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:47.294702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.297291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1085/2192] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:47.301756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.317593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df330e-516d-4706-b83a-d4dec7477183 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.324465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.325293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.325847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.326302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.327700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.330746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.374597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1086/2193] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:47.381009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.445492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1108/2194] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:47.451971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.453520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.470453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa86c89-188c-4706-b4d4-05654aebb0a4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.477506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.478357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.478637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.478908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.479546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.481877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.509865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1087/2195] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:47.516080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.517844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.530958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3607-d26a-4cfe-a898-b22b44157ac4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.536903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.537556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.537870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.538138 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] PATH_INFO: `/v3/users/5eaf5f7717e048018cd9696f88d22f9c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.539439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eaf5f7717e048018cd9696f88d22f9c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.541378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.563932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bbfc3-46d9-4fa7-8174-8b54aa6fda6b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.605682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:47.611730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eaf5f7717e048018cd9696f88d22f9c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:47.622289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eaf5f7717e048018cd9696f88d22f9c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:47.629864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:47.630891 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.631796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.632127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.632448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.634832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.637768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eaf5f7717e048018cd9696f88d22f9c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:47.639594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eaf5f7717e048018cd9696f88d22f9c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:47.650323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eaf5f7717e048018cd9696f88d22f9c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:47.678352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1088/2196] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:47 2022] DELETE /identity/v3/users/5eaf5f7717e048018cd9696f88d22f9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:47.679946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.688226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.723909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.725447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038f01-c02f-49b1-b925-b63c461b05d0 service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.736205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1109/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:47.737568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.737905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.738252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.760031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:47.761306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.793701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693572b-688a-42f1-adea-57d6efc71ca6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.799703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.800326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.800607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.800881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.801536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.803850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.821976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1089/2198] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:47.826452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.839120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da6361-1696-4f9c-be83-7c23222c6ce8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.849080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.849868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.850375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.850882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.851955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.857951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.858102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1110/2199] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:47.867907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.869613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:47.874818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1090/2200] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:47.878930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:47.902888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e76bc-1c9b-43cb-8b7b-c0f0e6de77b7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.910491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.911273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.911692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.913174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] PATH_INFO: `/v3/projects/d0f849a3268b4960bd41fee7ec788a18/users/74354425d557424aa9d42bda8f643944/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.953936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f849a3268b4960bd41fee7ec788a18, user_id=74354425d557424aa9d42bda8f643944, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.957119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafc09d-13f9-4c9b-817f-9fdd135b6a03 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:47.964134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9294c-0ff0-4c93-98c2-dfce621d835a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:47.968444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:47.969198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.969550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.969925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.973858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1091/2201] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:47 2022] PUT /identity/v3/projects/d0f849a3268b4960bd41fee7ec788a18/users/74354425d557424aa9d42bda8f643944/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:47.986945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:47.987466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:47.987890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:47.988194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:47.990259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3ca5-a62a-4cdf-a85f-e8e49ed04445 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.002228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1111/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:48.032258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] MFA Rules not processed for user `74354425d557424aa9d42bda8f643944`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:48.033975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.037616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.037942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.038223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.068922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:48.070744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.101487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:48.123490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1092/2203] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:48.129288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.146451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1112/2204] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:38:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:38:48.181910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:48.215873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.217290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.227822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0613-45a3-41db-82c7-bfbe4a1b4d93 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.234425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.235051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.235334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.235687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.236971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.238937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.276644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1093/2205] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:48 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:48.280340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.382471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e636-4619-4e22-9554-b1662c53856a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.392252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.392551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.392850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.393105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.394164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.394582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0cc4-9af8-412a-9cd7-2cb39b2eeb42 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.406104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.448379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1094/2206] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:48 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:38:48.452102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.491392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355f38-026f-4cf2-a601-69752898ff6b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.506604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.507216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.508050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.508467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.509112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.510939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.527445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1095/2207] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:48.528333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.532581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.532877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.533232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.533421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.536648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.551007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411b937-99e3-4084-856a-2cdf25d5c03c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.556020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.556799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.557083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.557445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] PATH_INFO: `/v3/projects/114306e05da04bbca23fdcfe56c21a04` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.558519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114306e05da04bbca23fdcfe56c21a04)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.560830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.634525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114306e05da04bbca23fdcfe56c21a04', 'request_id': 'req-e0d227f9-2e97-47e9-9b72-995fa61d2a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.639651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.641394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.647509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114306e05da04bbca23fdcfe56c21a04', 'request_id': 'req-e0d227f9-2e97-47e9-9b72-995fa61d2a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.664483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114306e05da04bbca23fdcfe56c21a04', 'request_id': 'req-e0d227f9-2e97-47e9-9b72-995fa61d2a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.672674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1113/2208] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 15:38:48.673694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.678278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] The token cache is being invalidate because project 114306e05da04bbca23fdcfe56c21a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:48.678586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.679348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.682249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1096/2209] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:48 2022] DELETE /identity/v3/projects/114306e05da04bbca23fdcfe56c21a04 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:48.701968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.704365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.724435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bc0f-df5a-4d29-b79a-61eb65c9be25 service swift] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.749505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:48.785703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:48.854964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.855645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.855927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.856204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] PATH_INFO: `/v3/projects/b7f3a1f564f94045918a4c2808960a39/users/406163fe8b174dc986d34c3ee68ef8e2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.857539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d227f9-2e97-47e9-9b72-995fa61d2a10 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:48.863097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:48.863751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:48.864028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:48.864501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] PATH_INFO: `/v3/users/d9f996da4644446e9c6200942f392a26` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:48.865924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f996da4644446e9c6200942f392a26)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.868910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.892964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f3a1f564f94045918a4c2808960a39, user_id=406163fe8b174dc986d34c3ee68ef8e2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:48.895696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:48.922517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1114/2210] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:48 2022] PUT /identity/v3/projects/b7f3a1f564f94045918a4c2808960a39/users/406163fe8b174dc986d34c3ee68ef8e2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:48.927757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:48.930603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:48.955224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f996da4644446e9c6200942f392a26'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.971009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f996da4644446e9c6200942f392a26'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.988228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f996da4644446e9c6200942f392a26'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.990075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f996da4644446e9c6200942f392a26'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:48.992823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f996da4644446e9c6200942f392a26'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.027668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1097/2211] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:48 2022] DELETE /identity/v3/users/d9f996da4644446e9c6200942f392a26 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:49.053090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb7c8a-8752-4fef-853a-352ca415414f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:49.158314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:49.159497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.160155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.160546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.161361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:49.165303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7100e1-fab5-48ac-9e88-ca7f9adc7eeb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:49.182708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1115/2212] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:49.186915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:49.188862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:49.218656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2542a-77c3-4013-988b-558a8c1e42d7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:49.224470 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:49.225352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.227011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.227746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] PATH_INFO: `/v3/projects/b7f3a1f564f94045918a4c2808960a39/users/406163fe8b174dc986d34c3ee68ef8e2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.232483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f3a1f564f94045918a4c2808960a39, user_id=406163fe8b174dc986d34c3ee68ef8e2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:49.253943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:49.297693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1098/2213] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:49 2022] PUT /identity/v3/projects/b7f3a1f564f94045918a4c2808960a39/users/406163fe8b174dc986d34c3ee68ef8e2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:49.308937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.309240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.309852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.379995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] MFA Rules not processed for user `406163fe8b174dc986d34c3ee68ef8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:49.381244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:49.453291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:49.512496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1116/2214] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:49.527608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:49.529327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:49.532024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:49.535447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:49.653502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348632-cf93-44be-958d-c5f742397bcd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:49.658388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:49.659018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419d2cc-0cfd-4cc9-b048-142522c557c7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:49.659716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.660141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.660584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] PATH_INFO: `/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.662078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4499b8f4b84b3bb133bd9e76f18e69)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:49.665071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:49.667908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:49.668660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.669035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.669403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.691331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:49.693190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a85fd-2b97-4886-aa77-0060429050f2 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:49.721495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:49.722324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1117/2215] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:49.766826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4499b8f4b84b3bb133bd9e76f18e69', 'request_id': 'req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.781679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4499b8f4b84b3bb133bd9e76f18e69', 'request_id': 'req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.796645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4499b8f4b84b3bb133bd9e76f18e69', 'request_id': 'req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.831306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] The token cache is being invalidate because project 8f4499b8f4b84b3bb133bd9e76f18e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:49.831669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.832445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ba13b6c0-a9a2-418c-a090-ff2d51cf4149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:49.838599 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1099/2216] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:49 2022] DELETE /identity/v3/projects/8f4499b8f4b84b3bb133bd9e76f18e69 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:49.839770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.840058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.840328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.868936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:49.870389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:49.964639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:49.964639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:49.964854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:49.999965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1118/2217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:50.002304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.012196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:50.055755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a2066-2526-490f-bc9c-9c0fee475826 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.062648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:50.063829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:50.080306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.080948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.081222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.081492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] PATH_INFO: `/v3/users/74354425d557424aa9d42bda8f643944` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.089251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74354425d557424aa9d42bda8f643944)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.090871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.104323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1100/2218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:50.105585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.131897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa935e1-4dad-4feb-9d08-28a6f74b1a47 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.143546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.143856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.144092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.144360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.145018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:50.145303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.146936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.185793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1101/2219] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:38:50.191487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.218784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64530-5116-41eb-8d76-306ab19e51a6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.222223 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74354425d557424aa9d42bda8f643944'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:50.235283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74354425d557424aa9d42bda8f643944'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:50.236222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74354425d557424aa9d42bda8f643944'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:50.236995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.237138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74354425d557424aa9d42bda8f643944'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:50.237935 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.238355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.240933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.242317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.248295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.254021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:50.255757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4aa9b77d-1508-44fc-a11e-8470258eeaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74354425d557424aa9d42bda8f643944'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:50.291730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1119/2220] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:49 2022] DELETE /identity/v3/users/74354425d557424aa9d42bda8f643944 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:50.302657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.304116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.305365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.328094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:50.329654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:50.364814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1102/2221] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:50 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:50.366133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.368248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:50.519197 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1120/2222] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:50.526093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.527591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:50.596215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ffd1-c3db-4ad2-965a-10bc5c6abf85 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.620154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.620154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.620154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.620154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.620636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.621624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.658143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1103/2223] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:50 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:50.662270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.684314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c11bb9-413f-4b3b-9cff-83c59975bcce admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.701926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb7f9-5fe2-4822-b548-5c466fbaaef6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.705543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.706268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.706606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.706908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.707910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.709482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.737508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1104/2224] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:50.742182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.764129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f0ea1-4314-4234-86e2-afd6f3921a45 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.778601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.780672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.781046 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.784127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.784127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.788109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.820835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1105/2225] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:50.822550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.823259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.823545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.823818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.825349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:50.843527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a345-d219-4366-95a4-4c81d15de43e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:50.850297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.852614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afa45d-98cb-4a81-9934-18b7bb2b04a0 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.862529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:50.863213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.863520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.863800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] PATH_INFO: `/v3/projects/732998a42be64742a7c1714241d9a981/users/f3ce730b677245bc887339e4bfc7bb7a/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.881642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1121/2226] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:38:50.891503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=732998a42be64742a7c1714241d9a981, user_id=f3ce730b677245bc887339e4bfc7bb7a, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:50.898284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:50.921884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1106/2227] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:50 2022] PUT /identity/v3/projects/732998a42be64742a7c1714241d9a981/users/f3ce730b677245bc887339e4bfc7bb7a/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:50.936092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:50.936506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:50.936880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:50.996762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] MFA Rules not processed for user `f3ce730b677245bc887339e4bfc7bb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:50.999199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:51.111738 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:51.192195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1122/2228] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:51.197431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.249575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:51.317611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965e18e-f1f1-4713-b9a2-e496df7bf7ea admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.323294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.323940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.324219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.324488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.325132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.327237 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.369162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1107/2229] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:51 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:51.373521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.389863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f132ac-765a-4a0d-8de9-3b6e52de4d6c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.489492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.490505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.490936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.491372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.492027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.494271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.504008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.505947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:51.526964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882eed-effa-4eae-bcb0-9d9298951c95 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.534551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.535248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.535557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.536127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] PATH_INFO: `/v3/projects/d0f849a3268b4960bd41fee7ec788a18` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.537984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f849a3268b4960bd41fee7ec788a18)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.540271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.561652 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1123/2230] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:51 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:51.565571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.583717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3839e4-7481-449c-85c8-28e65b736622 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.603563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.605419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.605704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.606002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.606673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.608915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.645660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1124/2231] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:51.650061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.670022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047b8c-0bc3-4094-9b7e-35290ae42ace admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.674701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f849a3268b4960bd41fee7ec788a18', 'request_id': 'req-7f63310f-a33b-405a-a7f3-c1778b62fe22'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:51.692620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f849a3268b4960bd41fee7ec788a18', 'request_id': 'req-7f63310f-a33b-405a-a7f3-c1778b62fe22'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:51.707360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f849a3268b4960bd41fee7ec788a18', 'request_id': 'req-7f63310f-a33b-405a-a7f3-c1778b62fe22'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:51.734033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] The token cache is being invalidate because project d0f849a3268b4960bd41fee7ec788a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:51.734403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:51.735637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:51.738248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1108/2232] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:51 2022] DELETE /identity/v3/projects/d0f849a3268b4960bd41fee7ec788a18 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:51.742188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.743943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:51.775302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.775972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.776253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.776578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] PATH_INFO: `/v3/projects/2e1eb9479e24458d8e898accfa894781/users/17bd75783cc74962b6d18329c5473d9f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.793283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1eb9479e24458d8e898accfa894781, user_id=17bd75783cc74962b6d18329c5473d9f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.796154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.816814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1125/2233] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:51 2022] PUT /identity/v3/projects/2e1eb9479e24458d8e898accfa894781/users/17bd75783cc74962b6d18329c5473d9f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:51.822065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.824486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:51.827251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63310f-a33b-405a-a7f3-c1778b62fe22 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.861775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:51.875787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:51.909961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.910210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424e4e4-43d2-48c9-b1ec-94c2045a4753 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.910318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.910318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.910318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] PATH_INFO: `/v3/users/406163fe8b174dc986d34c3ee68ef8e2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.911585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406163fe8b174dc986d34c3ee68ef8e2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.914066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.919509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.920217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.920577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.920918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.921649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.923822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.942545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1126/2234] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:51.947479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:51.963849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30317b-d3ad-4289-9712-a5cdaad744d6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:51.972894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:51.974285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:51.974830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:51.975274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] PATH_INFO: `/v3/projects/2e1eb9479e24458d8e898accfa894781/users/17bd75783cc74962b6d18329c5473d9f/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:51.978109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1eb9479e24458d8e898accfa894781, user_id=17bd75783cc74962b6d18329c5473d9f, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:51.982584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01137480-cc81-4a33-8628-219e59108e54 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:51.995201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406163fe8b174dc986d34c3ee68ef8e2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:52.013294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406163fe8b174dc986d34c3ee68ef8e2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:52.014259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1127/2235] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:51 2022] PUT /identity/v3/projects/2e1eb9479e24458d8e898accfa894781/users/17bd75783cc74962b6d18329c5473d9f/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:52.016854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:52.018343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:52.018845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:52.029868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406163fe8b174dc986d34c3ee68ef8e2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:52.030932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406163fe8b174dc986d34c3ee68ef8e2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:52.033335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406163fe8b174dc986d34c3ee68ef8e2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:52.057488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1109/2236] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:51 2022] DELETE /identity/v3/users/406163fe8b174dc986d34c3ee68ef8e2 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:52.061617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] MFA Rules not processed for user `17bd75783cc74962b6d18329c5473d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:52.062956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:52.198311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1128/2237] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:52.211552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:52.213095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:52.357185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603ff2-1337-4305-bd27-e74c465bd9f1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:52.366422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:52.367641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:52.368900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:52.369182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:52.379789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:52.568552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:52.570661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7571b-de64-43a2-9494-1a1995b43446 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:52.618475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1110/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:52.619591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:52.623455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:52.845986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80407e-59ac-454a-8799-af0ca7b1d442 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:52.861457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:52.862538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:52.862982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:52.863411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] PATH_INFO: `/v3/projects/b7f3a1f564f94045918a4c2808960a39` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:52.864743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f3a1f564f94045918a4c2808960a39)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:52.866901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.018028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:53.032155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f3a1f564f94045918a4c2808960a39', 'request_id': 'req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:53.044371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f3a1f564f94045918a4c2808960a39', 'request_id': 'req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:53.057855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f3a1f564f94045918a4c2808960a39', 'request_id': 'req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:53.078739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] The token cache is being invalidate because project b7f3a1f564f94045918a4c2808960a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:53.079280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:53.080175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-0af6dd7d-70a6-47ba-ae66-972f7ba2f9be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:53.086635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1129/2239] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:52 2022] DELETE /identity/v3/projects/b7f3a1f564f94045918a4c2808960a39 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:53.089201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.089201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.089201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.115017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:53.131952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:53.133983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:53.347569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1111/2240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:53.349147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.349632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.349710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.373400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:53.374882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:53.392400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.397932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1130/2241] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:53.404869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17cf4f-bd12-411f-b0fa-b2914c52756e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.412264 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.412760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.412883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.413126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.414181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:38:53.414484 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.416101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.433212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1112/2242] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:38:53.437788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.452735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e7a40-775e-4e35-8c54-2eacd2d16ba7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.460971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.461817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.462252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.462527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.463165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.465329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.505332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1131/2243] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:53.507282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.520661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0f1f8-36b7-492f-bbbe-de7201364e66 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.592500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.594802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.594802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.594802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.595120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.597240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.628609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1113/2244] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:53.630062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.642358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592e83-0db2-4c67-9f45-c6800c8d409c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.648740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.649656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.650191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.650720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.651437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.653203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.666454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1132/2245] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:53.670297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.685057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4b8a2-6182-4ebb-b4b2-94ac22ef89dd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.690488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.691313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.691435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.691652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.692296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.693993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7236120-fd4a-47b3-8fb4-c927abac6089 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.712901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1114/2246] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:53.717133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:53.730519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2ffa3-6ccb-416f-96b5-05ca441be106 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:53.735934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:53.737010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.737512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.738034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] PATH_INFO: `/v3/projects/c0f15fa04a3440d895ee3fd120aded9c/users/3e03a7c8454b46d5b3ac3075de11e167/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.755858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f15fa04a3440d895ee3fd120aded9c, user_id=3e03a7c8454b46d5b3ac3075de11e167, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:53.759486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:53.785769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1133/2247] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:53 2022] PUT /identity/v3/projects/c0f15fa04a3440d895ee3fd120aded9c/users/3e03a7c8454b46d5b3ac3075de11e167/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:53.856045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:53.857818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:53.857998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:53.891301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] MFA Rules not processed for user `3e03a7c8454b46d5b3ac3075de11e167`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:53.893008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:53.971658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1115/2248] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:53.976926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.047475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61f908-58cd-488a-bd46-8db66bc90bd1 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.052716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.053347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.053915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.054795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.058488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.060521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.099264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1134/2249] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:38:53 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:54.100653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.116371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:54.123948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e2ae-156f-4ca1-b72c-dcf7e19c3488 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.190173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.190784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.191049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.191315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.192018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.193973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.221353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1116/2250] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:38:54 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:38:54.228389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.239851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e462c0-bf88-48c9-bcf6-691cd105c3e2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.245332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.246176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.246451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.246716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.247505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.249109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.266737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.267669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1135/2251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:38:54.293974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70bdaf-d373-46f3-970f-fc971b80a67e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.303537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.303537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.303537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.303537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] PATH_INFO: `/v3/projects/f4959cebfbb94c4c990f6e72b13446fa/users/9a0ab26bcda24ef2af6c2470217c4afd/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.357101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4959cebfbb94c4c990f6e72b13446fa, user_id=9a0ab26bcda24ef2af6c2470217c4afd, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.361706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.385983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1117/2252] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:54 2022] PUT /identity/v3/projects/f4959cebfbb94c4c990f6e72b13446fa/users/9a0ab26bcda24ef2af6c2470217c4afd/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:38:54.389767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.401672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e2d3-468d-48cb-8f19-97bcef9b4602 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.426668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.428934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:54.490397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:54.512506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.513358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.513985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.514428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.516364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.518422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.530563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1136/2253] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:38:54.535977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.550574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10260bd1-8f60-4947-b315-b844158be540 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.572555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c056b9-5c28-4330-9d3a-61a9f7b425b2 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.576514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.577389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.578035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.579764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.584599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.585398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.586231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.586507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] PATH_INFO: `/v3/projects/f4959cebfbb94c4c990f6e72b13446fa/users/9a0ab26bcda24ef2af6c2470217c4afd/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.588183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:54.588894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4959cebfbb94c4c990f6e72b13446fa, user_id=9a0ab26bcda24ef2af6c2470217c4afd, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.591552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda86da-97b5-4247-81cc-694f111cc631 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.609530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1137/2254] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:38:54 2022] PUT /identity/v3/projects/f4959cebfbb94c4c990f6e72b13446fa/users/9a0ab26bcda24ef2af6c2470217c4afd/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:54.619911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.620240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.620451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:54.652748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] MFA Rules not processed for user `9a0ab26bcda24ef2af6c2470217c4afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:54.654024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:54.737825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:54.739285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:54.765168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1118/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:54.788273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1138/2256] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:54.804568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:54.807185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:54.825655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03bd2a-89cc-4b6e-b612-d6e6814d07ee service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:54.851383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:54.916758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:54.917383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:54.917662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:54.917973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:55.005337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:55.006727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d5d80-5dbe-434e-b7c4-6af3ec5699f6 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:55.019360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1119/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:58.834288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:58.836529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:58.930275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a3ce5-8761-407b-b01d-982434d1fc3c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:58.952612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:58.953639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:58.954080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:58.954770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] PATH_INFO: `/v3/users/f3ce730b677245bc887339e4bfc7bb7a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:58.956015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ce730b677245bc887339e4bfc7bb7a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:58.958217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:59.031071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ce730b677245bc887339e4bfc7bb7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.041057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ce730b677245bc887339e4bfc7bb7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.041879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ce730b677245bc887339e4bfc7bb7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.042595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ce730b677245bc887339e4bfc7bb7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.044864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:59.062207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ce730b677245bc887339e4bfc7bb7a'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.080459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1139/2258] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:58 2022] DELETE /identity/v3/users/f3ce730b677245bc887339e4bfc7bb7a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:59.084833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:59.088544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:59.088544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:59.110965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:38:59.112478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:59.184841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1120/2259] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:38:59.197386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:59.200523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:59.283451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe3ab2-779b-4108-92be-33a82cb5ecb3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:59.301172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:59.301993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:59.302636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:59.302919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:59.320288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:59.321912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:59.337550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1140/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:38:59.720311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:59.721983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:59.731586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:59.733010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:59.762536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7145f1-a482-41d0-85bf-370c751cbd12 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:59.775305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:59.776016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:59.776185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:59.776605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] PATH_INFO: `/v3/projects/732998a42be64742a7c1714241d9a981` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:59.777816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] RBAC: Authorizing `identity:delete_project(project_id=732998a42be64742a7c1714241d9a981)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:38:59.780419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:38:59.832844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1cae4-e78f-4e78-8d09-362cc7bdd72b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:38:59.852638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732998a42be64742a7c1714241d9a981', 'request_id': 'req-6e93433a-225b-4374-b271-49a39724753d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.860643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732998a42be64742a7c1714241d9a981', 'request_id': 'req-6e93433a-225b-4374-b271-49a39724753d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.872800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732998a42be64742a7c1714241d9a981', 'request_id': 'req-6e93433a-225b-4374-b271-49a39724753d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.882849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:38:59.890423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] The token cache is being invalidate because project 732998a42be64742a7c1714241d9a981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:38:59.890845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.891901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:38:59.901109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1141/2261] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:38:59 2022] DELETE /identity/v3/projects/732998a42be64742a7c1714241d9a981 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:38:59.902725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:38:59.904391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:38:59.915433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:38:59.916050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:38:59.916318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:38:59.916588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:38:59.918336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:00.000804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93433a-225b-4374-b271-49a39724753d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:00.016458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:00.017823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:00.027276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:00.027935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:00.028220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:00.028496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] PATH_INFO: `/v3/users/17bd75783cc74962b6d18329c5473d9f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:00.030362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bd75783cc74962b6d18329c5473d9f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:00.031660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1121/2262] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:00.032323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:00.035072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:00.133344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bd75783cc74962b6d18329c5473d9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:00.150048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bd75783cc74962b6d18329c5473d9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:00.150982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bd75783cc74962b6d18329c5473d9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:00.152780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bd75783cc74962b6d18329c5473d9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:00.181035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eb7e4b24-b9f7-483c-9a03-70d56b9b1b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bd75783cc74962b6d18329c5473d9f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:00.201952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1142/2263] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:38:59 2022] DELETE /identity/v3/users/17bd75783cc74962b6d18329c5473d9f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:00.890351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:00.906234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32d347-9fd1-4c1b-b987-8ad0d868d7ee service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:00.998604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:00.999723 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.000311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.000793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] PATH_INFO: `/v3/projects/2e1eb9479e24458d8e898accfa894781` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.002307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1eb9479e24458d8e898accfa894781)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.004926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.062018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1eb9479e24458d8e898accfa894781', 'request_id': 'req-83cb36d0-1e20-4e21-a485-430bbabe12bf'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:01.072452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1eb9479e24458d8e898accfa894781', 'request_id': 'req-83cb36d0-1e20-4e21-a485-430bbabe12bf'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:01.080888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1eb9479e24458d8e898accfa894781', 'request_id': 'req-83cb36d0-1e20-4e21-a485-430bbabe12bf'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:01.095012 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] The token cache is being invalidate because project 2e1eb9479e24458d8e898accfa894781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:01.095428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:01.096183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-83cb36d0-1e20-4e21-a485-430bbabe12bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:01.097839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1122/2264] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:00 2022] DELETE /identity/v3/projects/2e1eb9479e24458d8e898accfa894781 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:01.103036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.103553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.103782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.125777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:01.127371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:01.190606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1143/2265] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:01.199267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.199543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.199813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.221956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:01.223164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:01.232260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1123/2266] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:01.240548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.251044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c950e-ca41-40e6-8a00-133b4a9999c5 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.256702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.257904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.261995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.262292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.262969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:01.263280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.264921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.278101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1144/2267] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:39:01.282561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.287861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:01.295677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cb5b3-f387-46d1-9289-1c7d59764b70 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.301502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.302119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.302396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.302663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.303284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.305351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490c81-79e8-4ed4-af63-818c0e593e7b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.346438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1124/2268] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:01.348496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.363313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fd999-bc13-4c45-bd76-c02ab8796e0d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.422829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.423118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.423410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.429413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.430158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.430515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.430856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.431494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.433422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.443776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] MFA Rules not processed for user `a581b2094e964dc0bbec27582ea503e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:01.445025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:01.445951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:01.462012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1145/2269] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:01.462848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.473656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690c64-791d-411a-b9ce-191695796f39 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.479386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.480018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.480304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.480579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.481216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.482862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.497769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1146/2270] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:01.499604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.510254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5a51d-90fe-4cdb-ac38-deed3f515172 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.511756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1125/2271] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:01.515739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.516695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.516996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.517334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.518075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.519966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85380-76b0-43dd-904e-6ab6d5bafcba admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.531665 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1147/2272] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:01.536166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.562365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9adc86-b98f-49dc-8949-2af24e24f5a3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.566890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.567636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.567794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.568064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] PATH_INFO: `/v3/projects/9566771250874f80a8ca7cb404ed12b3/users/77563f3b99504f538ca69db5eaacd047/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.586195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9566771250874f80a8ca7cb404ed12b3, user_id=77563f3b99504f538ca69db5eaacd047, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.588926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.602943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1126/2273] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:01 2022] PUT /identity/v3/projects/9566771250874f80a8ca7cb404ed12b3/users/77563f3b99504f538ca69db5eaacd047/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:01.614074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.614466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.614776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.647247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] MFA Rules not processed for user `77563f3b99504f538ca69db5eaacd047`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:01.648984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:01.722107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1148/2274] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:01.727195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.794431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd1ccd-d436-4b84-9187-442443a2507a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.799623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.800220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.800496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.800814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.801538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.803492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.831441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1127/2275] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:01.835181 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.846425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cc85f-eb06-4c7a-af9f-2684b6f5b18f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.912145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.912640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.913027 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.913927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.914796 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.916777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.941707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1149/2276] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:01 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:01.945712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.957074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6f912-8226-43a8-8145-825efd9477b6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:01.963483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:01.964314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:01.964761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:01.965177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:01.966010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:01.967787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:01.984011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1128/2277] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:01.987964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:01.999057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f27b49-3003-4cca-bd6f-35673c66307a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.003731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.004308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.004584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.004853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.005602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.007142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fad5cc-5401-49f2-95c6-3d08ccb2fd16 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.017763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1150/2278] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:02.021866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.033057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238d32c-f006-46a6-8431-8c2afd1ba48f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.038763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.039540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.039818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.040326 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] PATH_INFO: `/v3/projects/f560ceaa4e94457f80e8c207c45e64ef/users/834e4c45b7be452e93d625e036e2b4a7/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.062454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f560ceaa4e94457f80e8c207c45e64ef, user_id=834e4c45b7be452e93d625e036e2b4a7, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.065362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.078736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1129/2279] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:02 2022] PUT /identity/v3/projects/f560ceaa4e94457f80e8c207c45e64ef/users/834e4c45b7be452e93d625e036e2b4a7/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:02.089143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.089438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.089715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.134504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] MFA Rules not processed for user `834e4c45b7be452e93d625e036e2b4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:02.136083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:02.172782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:02.215338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1151/2280] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:02.216983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.230014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:02.282213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260127a-8e3f-4a41-ac16-92eb2125949a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.287081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.287670 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.287941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.288206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.288846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.290748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.318403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1130/2281] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:02 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:02.323288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.334020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b874-f069-49f4-a602-9c0d9965c35c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.390412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.391033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.391300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.391694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.392207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.394186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.415996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1152/2282] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:02 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:02.420047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.431157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edb82-191b-4767-8ae7-b1896ac9fa62 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.436465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.437112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.437397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.437668 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.438365 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.439983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.451434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1131/2283] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:02.455590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.466028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb50ced-52f4-44b1-a978-d805be19631b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.471529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.472341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.472684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.473064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] PATH_INFO: `/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27/users/6b2b81b486a543c4ab0889deb024ad0c/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.489216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c88654a4ae4ea7bc11ed8ce4640c27, user_id=6b2b81b486a543c4ab0889deb024ad0c, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.492640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.505253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1153/2284] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:02 2022] PUT /identity/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27/users/6b2b81b486a543c4ab0889deb024ad0c/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:02.509956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.522817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d0c58-a4d9-493f-af17-9dcb2d412acb admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.583677 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.584282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.584554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.584824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.585490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.587094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeab2b-43df-46f9-963b-74239e958b38 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.597699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1132/2285] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:02.601937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.612210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b7459-17c9-4ffa-95e9-8dd2f604f73f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.617705 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.618438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.618664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.618930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] PATH_INFO: `/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27/users/6b2b81b486a543c4ab0889deb024ad0c/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.621343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c88654a4ae4ea7bc11ed8ce4640c27, user_id=6b2b81b486a543c4ab0889deb024ad0c, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.624207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.639208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1154/2286] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:02 2022] PUT /identity/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27/users/6b2b81b486a543c4ab0889deb024ad0c/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:02.649499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.649875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.650152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.687858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] MFA Rules not processed for user `6b2b81b486a543c4ab0889deb024ad0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:02.689253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:02.784828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1133/2287] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:02.816247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.819492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:02.885019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab18a36-64f3-4826-9931-a31373b3d52b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.888745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.889349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.889626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.889931 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.900682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:02.902356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbaf2dd-ec76-4deb-b22a-7e6deabd6390 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:02.913094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1155/2288] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:02.958931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:02.960489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:02.982468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5be05-0941-4925-a7d1-b39c6937bd59 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:02.986314 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:02.986973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:02.987251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:02.987529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:02.992874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:03.058862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:03.060318 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:03.071251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1134/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:03.769681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:03.770233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:03.770357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:03.790544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:03.791762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:03.812724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:03.851881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1156/2290] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:03.865154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:03.866697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:03.949511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853262e-673c-4ed5-8291-980cafa5a225 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:03.954621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:03.955213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:03.955502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:03.955775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:03.964894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:03.966552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5fc6-8c2d-49ca-80da-834e4ca8419b service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:03.975485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1135/2291] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:39:06.266265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:06.353888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df07b-c401-4b74-9fa6-76a25acf7aac None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:06.358426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:06.359145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:06.359491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:06.359849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] PATH_INFO: `/v3/users/77563f3b99504f538ca69db5eaacd047` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:06.360961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77563f3b99504f538ca69db5eaacd047)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:06.362912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:06.414107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77563f3b99504f538ca69db5eaacd047'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.422444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77563f3b99504f538ca69db5eaacd047'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.423064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77563f3b99504f538ca69db5eaacd047'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.423672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77563f3b99504f538ca69db5eaacd047'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.435894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77563f3b99504f538ca69db5eaacd047'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.448851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1157/2292] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:06 2022] DELETE /identity/v3/users/77563f3b99504f538ca69db5eaacd047 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:06.453436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:06.453992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:06.454094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:06.479757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:06.482144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:06.565168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1136/2293] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:06.575511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:06.577152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:06.660324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:06.661931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:06.665503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b85ed2-fde5-47fd-a539-6444fe17e043 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:06.669107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:06.669916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:06.670193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:06.670459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:06.675203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6f9a-d8bb-46ea-9e72-395cf24df33f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:06.677191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:06.682640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:06.684863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd16ae-82a2-48f7-8f2d-470e6d7fc601 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:06.686682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:06.687337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:06.687610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:06.687878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] PATH_INFO: `/v3/users/3e03a7c8454b46d5b3ac3075de11e167` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:06.689613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e03a7c8454b46d5b3ac3075de11e167)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:06.691268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:06.695240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1158/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:06.727447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:06.742358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e03a7c8454b46d5b3ac3075de11e167'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.751042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e03a7c8454b46d5b3ac3075de11e167'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.768097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e03a7c8454b46d5b3ac3075de11e167'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.769005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e03a7c8454b46d5b3ac3075de11e167'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.769917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e03a7c8454b46d5b3ac3075de11e167'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:06.792402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1137/2295] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:06 2022] DELETE /identity/v3/users/3e03a7c8454b46d5b3ac3075de11e167 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:06.793703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:06.794182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:06.794623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:06.820061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:06.822613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:06.921401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1159/2296] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:06.928202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:06.929704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:07.004703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8971b-115b-4c35-bf6d-5cec5aa3a722 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:07.010586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:07.012011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:07.012789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:07.013286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:07.013633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:07.014291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:07.029248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:07.038787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09feecdd-f1fa-4880-a13b-6e6f9a5e7005 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:07.046305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:07.050542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:07.051178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:07.051445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:07.051715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] PATH_INFO: `/v3/projects/9566771250874f80a8ca7cb404ed12b3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:07.052890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9566771250874f80a8ca7cb404ed12b3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:07.054881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:07.059215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1138/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:07.143216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9566771250874f80a8ca7cb404ed12b3', 'request_id': 'req-306e08f2-696f-4463-aeab-103621ab62dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.159999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9566771250874f80a8ca7cb404ed12b3', 'request_id': 'req-306e08f2-696f-4463-aeab-103621ab62dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.189588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9566771250874f80a8ca7cb404ed12b3', 'request_id': 'req-306e08f2-696f-4463-aeab-103621ab62dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.222969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] The token cache is being invalidate because project 9566771250874f80a8ca7cb404ed12b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:07.223288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.226624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.231766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1160/2298] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:07 2022] DELETE /identity/v3/projects/9566771250874f80a8ca7cb404ed12b3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:07.236081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:07.250577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b7bb-93d9-4fd3-a90c-98313b9b56e3 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:07.382527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:07.383163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:07.383435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:07.384102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] PATH_INFO: `/v3/users/834e4c45b7be452e93d625e036e2b4a7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:07.385282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=834e4c45b7be452e93d625e036e2b4a7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:07.388530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:07.490005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834e4c45b7be452e93d625e036e2b4a7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.508386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:07.517637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834e4c45b7be452e93d625e036e2b4a7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.533308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834e4c45b7be452e93d625e036e2b4a7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.534334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834e4c45b7be452e93d625e036e2b4a7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.534943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834e4c45b7be452e93d625e036e2b4a7'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.569818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1139/2299] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:07 2022] DELETE /identity/v3/users/834e4c45b7be452e93d625e036e2b4a7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:07.636359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:07.638057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:07.667926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e08f2-696f-4463-aeab-103621ab62dd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:07.770540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:07.786997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:07.787504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:07.787878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] PATH_INFO: `/v3/projects/c0f15fa04a3440d895ee3fd120aded9c` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:07.789543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f15fa04a3440d895ee3fd120aded9c)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:07.794169 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:07.837784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:07.890453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f15fa04a3440d895ee3fd120aded9c', 'request_id': 'req-f9156159-7c20-4379-8722-faaf90b2426f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.906222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f15fa04a3440d895ee3fd120aded9c', 'request_id': 'req-f9156159-7c20-4379-8722-faaf90b2426f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.924821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f15fa04a3440d895ee3fd120aded9c', 'request_id': 'req-f9156159-7c20-4379-8722-faaf90b2426f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.952518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] The token cache is being invalidate because project c0f15fa04a3440d895ee3fd120aded9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:07.953563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.956942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:07.968615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1161/2300] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:07 2022] DELETE /identity/v3/projects/c0f15fa04a3440d895ee3fd120aded9c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:07.973649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:07.975967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:07.993805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:07.993805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:08.009329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5a9b-998c-4ad2-a064-b15d6e87cd3e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:08.080195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:08.081020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:08.081313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:08.081585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] PATH_INFO: `/v3/users/9a0ab26bcda24ef2af6c2470217c4afd` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:08.082770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0ab26bcda24ef2af6c2470217c4afd)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:08.084706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:08.087019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9156159-7c20-4379-8722-faaf90b2426f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:08.092899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:08.093640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:08.094053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:08.094425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] PATH_INFO: `/v3/projects/f560ceaa4e94457f80e8c207c45e64ef` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:08.095669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f560ceaa4e94457f80e8c207c45e64ef)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:08.097669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:08.154422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0ab26bcda24ef2af6c2470217c4afd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.163009 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0ab26bcda24ef2af6c2470217c4afd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.165938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f560ceaa4e94457f80e8c207c45e64ef', 'request_id': 'req-1c11053b-9240-4f73-acc6-8c404cbc8da6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.174468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f560ceaa4e94457f80e8c207c45e64ef', 'request_id': 'req-1c11053b-9240-4f73-acc6-8c404cbc8da6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.177421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0ab26bcda24ef2af6c2470217c4afd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.178277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0ab26bcda24ef2af6c2470217c4afd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.179060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0ab26bcda24ef2af6c2470217c4afd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.186161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f560ceaa4e94457f80e8c207c45e64ef', 'request_id': 'req-1c11053b-9240-4f73-acc6-8c404cbc8da6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.199035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1140/2301] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:07 2022] DELETE /identity/v3/users/9a0ab26bcda24ef2af6c2470217c4afd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:08.203370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] The token cache is being invalidate because project f560ceaa4e94457f80e8c207c45e64ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:08.203666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.204404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.206598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1162/2302] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:07 2022] DELETE /identity/v3/projects/f560ceaa4e94457f80e8c207c45e64ef => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:08.214384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:08.220058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:08.296539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:08.317150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1af6c-3ea5-4d56-96fe-7012b42e5207 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:08.325771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:08.326325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:08.326714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:08.327126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] PATH_INFO: `/v3/users/6b2b81b486a543c4ab0889deb024ad0c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:08.328397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2b81b486a543c4ab0889deb024ad0c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:08.330632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:08.427656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2b81b486a543c4ab0889deb024ad0c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.458958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2b81b486a543c4ab0889deb024ad0c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.483705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2b81b486a543c4ab0889deb024ad0c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.484681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2b81b486a543c4ab0889deb024ad0c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.486553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2b81b486a543c4ab0889deb024ad0c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:08.512860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1141/2303] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:08 2022] DELETE /identity/v3/users/6b2b81b486a543c4ab0889deb024ad0c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:08.853427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:08.855775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:08.981904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:09.031800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11053b-9240-4f73-acc6-8c404cbc8da6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.110618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.111939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.112644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.113306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] PATH_INFO: `/v3/projects/f4959cebfbb94c4c990f6e72b13446fa` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.114794 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4959cebfbb94c4c990f6e72b13446fa)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.117044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.146185 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.147703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:09.175277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145212-2130-483d-a3d9-0b671a855dd6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.182356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.183053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.183368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.183647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] PATH_INFO: `/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.185013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c88654a4ae4ea7bc11ed8ce4640c27)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.187212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.226146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4959cebfbb94c4c990f6e72b13446fa', 'request_id': 'req-b7f88692-edc7-47a2-bdea-1fb203b2380b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.240664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4959cebfbb94c4c990f6e72b13446fa', 'request_id': 'req-b7f88692-edc7-47a2-bdea-1fb203b2380b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.256589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4959cebfbb94c4c990f6e72b13446fa', 'request_id': 'req-b7f88692-edc7-47a2-bdea-1fb203b2380b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.257515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c88654a4ae4ea7bc11ed8ce4640c27', 'request_id': 'req-094c1d07-9f84-4464-a056-1183a9071f1f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.268549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c88654a4ae4ea7bc11ed8ce4640c27', 'request_id': 'req-094c1d07-9f84-4464-a056-1183a9071f1f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.276266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] The token cache is being invalidate because project f4959cebfbb94c4c990f6e72b13446fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:09.276554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.277248 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b7f88692-edc7-47a2-bdea-1fb203b2380b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.279284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1163/2304] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:08 2022] DELETE /identity/v3/projects/f4959cebfbb94c4c990f6e72b13446fa => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:09.280951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c88654a4ae4ea7bc11ed8ce4640c27', 'request_id': 'req-094c1d07-9f84-4464-a056-1183a9071f1f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.285840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae3dc-35f3-45f7-b014-b83f6978a1db None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.286415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae3dc-35f3-45f7-b014-b83f6978a1db None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.289222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ae3dc-35f3-45f7-b014-b83f6978a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.299968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] The token cache is being invalidate because project 24c88654a4ae4ea7bc11ed8ce4640c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:09.300309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.305270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-094c1d07-9f84-4464-a056-1183a9071f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:09.313499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1142/2305] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:09 2022] DELETE /identity/v3/projects/24c88654a4ae4ea7bc11ed8ce4640c27 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:09.315739 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218e3-ab14-4ddb-bfd5-60d94ae6651f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.316030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218e3-ab14-4ddb-bfd5-60d94ae6651f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.316308 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218e3-ab14-4ddb-bfd5-60d94ae6651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.337801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-725ae3dc-35f3-45f7-b014-b83f6978a1db None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:09.340137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-725ae3dc-35f3-45f7-b014-b83f6978a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:09.375162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6d3218e3-ab14-4ddb-bfd5-60d94ae6651f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:09.378832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6d3218e3-ab14-4ddb-bfd5-60d94ae6651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:09.437895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1164/2306] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:09.447315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.447602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.447874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.482469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:09.490412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:09.492737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:09.510648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1165/2307] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:09.512187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.530278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1143/2308] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:09.539147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333bbbd-3c08-4585-906b-c69a31d7292c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.540208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.540514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.540804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.554029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.556694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.557155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.559933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.560802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:09.561291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.564435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.564635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:09.565883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:09.573139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:09.576512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1144/2309] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:09.581177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.593619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c6131-cf17-484f-9df8-714d2646a121 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.597919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1166/2310] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:39:09.598789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.602033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.602676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.602949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.603221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.603914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:09.604211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.605819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.612360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0ec6a-d790-4682-9e86-7e558af8fdb3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.617461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.618138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.622466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.622466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.622699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1145/2311] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:39:09.622789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.622789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.625231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.665461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0660911-37e7-44dc-b733-9b889d611d21 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.666952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1167/2312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:09.670750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.796724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611e6e8-ce41-452c-93a9-ec5759a2dce2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.800011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.800801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.801437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.801646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.802324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.803049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.803758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.804158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.804427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.804605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.806088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.808085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:09.839297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1168/2313] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:39:09.844959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.861855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1146/2314] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:09.863087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:09.871802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4cc06-6e5e-4521-9750-8adc2e599560 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:09.976574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:09.978437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:09.978939 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:09.979432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:09.981001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:09.985612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.004315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1169/2315] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:10.010225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.042717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87894b7-145d-4e5b-8a97-7f134214111e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.049828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.051267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.051632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.052012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.052376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080f347-8e69-4631-8dba-c3f5ec339cbf admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.053251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.055146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.068556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.069181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.069473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.069767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.070406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.073778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.074310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1170/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:10.079576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.097117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb729-49c5-4259-9c3c-3252f75309ec admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.113768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.113768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.113768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.113768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] PATH_INFO: `/v3/projects/0925838341db441f87a99b84c0e31fab/users/91b49eebbc004ce0b0d752fd21cb17e9/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.121554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1147/2317] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:09 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:10.121872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.139608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a62c1-b00b-4828-b231-b350a6b3ab73 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.144864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.145417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0925838341db441f87a99b84c0e31fab, user_id=91b49eebbc004ce0b0d752fd21cb17e9, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.145936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.146442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.146930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.147975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.148188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3777ae7-250a-422c-be4f-722004bc20a5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.150970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.172350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1148/2318] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:10.172583 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1171/2319] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:10 2022] PUT /identity/v3/projects/0925838341db441f87a99b84c0e31fab/users/91b49eebbc004ce0b0d752fd21cb17e9/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:10.176545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.186613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.187348 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.187708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.203959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6db41-8a18-4a07-ad08-37db5488a84f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.231620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] MFA Rules not processed for user `91b49eebbc004ce0b0d752fd21cb17e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:10.244601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:10.255401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:10.280964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:10.299911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.300524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.300799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.301093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.301968 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.304376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.319544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1149/2320] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:10.324781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.340152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e99abd-e48a-4ee9-8197-c33bde26050f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.366716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.367409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.367691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.368166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] PATH_INFO: `/v3/projects/34ca0ca2471a45769e755ffda2688f55/users/85faaf60dd194263871d0e6568b86a3f/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.389701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ca0ca2471a45769e755ffda2688f55, user_id=85faaf60dd194263871d0e6568b86a3f, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.392443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602b52f-0137-4aa2-84d0-3631369d0e66 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.433270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1150/2321] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:10 2022] PUT /identity/v3/projects/34ca0ca2471a45769e755ffda2688f55/users/85faaf60dd194263871d0e6568b86a3f/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:10.435245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1172/2322] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:10.436915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.438131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.438417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.447504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.450435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:10.477724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] MFA Rules not processed for user `85faaf60dd194263871d0e6568b86a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:10.479658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:10.600330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1151/2323] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:10.602346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.622167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ffbf-9e44-4105-abdc-6c7f545d197d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.733265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457189-c7f9-4fb5-885e-69eb71f7f1d3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.737722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.738429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.738835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.739118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.747537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.747906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.748274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.748731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.749377 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.751338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.812049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.813560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.826961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1173/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:10.826961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.827978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1152/2325] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:10 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:10.828279 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:10.829346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.847900 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b088-d120-470c-97af-935861722c7d service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.872752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:10.876040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:10.930025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.931817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.932277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.932739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] PATH_INFO: `/v3/users/621a68b397c5447596402a324da66665` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.933014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c330-f888-4c18-9de7-4dbd67706d0a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:10.934445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] RBAC: Authorizing `identity:delete_user(user_id=621a68b397c5447596402a324da66665)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.936770 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.937776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:10.938453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:10.938737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:10.939010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:10.939878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:10.942769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:10.978661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1153/2326] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:10 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:10.979704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:10.998959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aebc6-909a-4fb2-9371-dde3d5294176 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.005003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.005609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.005930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.006198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.007690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.009487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.038302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1154/2327] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:11.045040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.073897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621a68b397c5447596402a324da66665'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:11.076622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195f38d-73f1-4ba5-8a37-8adc5e7fdad2 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.091630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.092368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.093236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.094694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.096462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.098721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621a68b397c5447596402a324da66665'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:11.099428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621a68b397c5447596402a324da66665'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:11.100141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621a68b397c5447596402a324da66665'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:11.104842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.121358 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1155/2328] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:11.126818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.133763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb4f717d-9ead-421c-afda-5c82474c063d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621a68b397c5447596402a324da66665'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:11.135539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:11.157646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1174/2329] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:10 2022] DELETE /identity/v3/users/621a68b397c5447596402a324da66665 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:11.165646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1c8a4-052c-4259-938d-95bff722e83a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.300463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.301461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.301974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.302469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] PATH_INFO: `/v3/projects/b024e12e825741dd917f9d4f54348d1b/users/0670b08a6016431cb4461c2a8f2c1fa2/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.333295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b024e12e825741dd917f9d4f54348d1b, user_id=0670b08a6016431cb4461c2a8f2c1fa2, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.336213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.375866 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1156/2330] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:11 2022] PUT /identity/v3/projects/b024e12e825741dd917f9d4f54348d1b/users/0670b08a6016431cb4461c2a8f2c1fa2/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:11.390533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.390778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.391153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.466051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] MFA Rules not processed for user `0670b08a6016431cb4461c2a8f2c1fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:11.469643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:11.610034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1175/2331] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:11.617806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.681039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.683001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:11.736415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501af71-d3a7-442f-9f2d-c4184e671182 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.745759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.746449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.746709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.747032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.747667 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.749694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.776875 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:11.777974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:11.795460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1157/2332] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:11 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:11.797804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.828604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44c96a-4c0b-48f8-b57b-d76b843fc9f2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.888826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477a19c-10d1-489b-ab91-784309195663 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.893759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.894391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.894790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.895390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.896025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.896766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.897441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.897826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.898123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.898244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] PATH_INFO: `/v3/projects/b088c2f28a1b4cc6a963d70dc3fba4e6` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.900166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b088c2f28a1b4cc6a963d70dc3fba4e6)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.902835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.937376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1158/2333] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:11 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:11.942198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:11.954517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84fa69-df92-435c-b02b-033f45382203 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:11.959870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:11.961424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:11.961780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:11.962071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:11.963048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:11.964920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:11.980514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1159/2334] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:11.987092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.004985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b088c2f28a1b4cc6a963d70dc3fba4e6', 'request_id': 'req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.007925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2421-7058-4fa7-ba12-b9296c0fa506 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.014421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b088c2f28a1b4cc6a963d70dc3fba4e6', 'request_id': 'req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.028666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b088c2f28a1b4cc6a963d70dc3fba4e6', 'request_id': 'req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.050528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] The token cache is being invalidate because project b088c2f28a1b4cc6a963d70dc3fba4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:12.050861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.051563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.056167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1176/2335] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:11 2022] DELETE /identity/v3/projects/b088c2f28a1b4cc6a963d70dc3fba4e6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:12.057061 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.058641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.093156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:12.094220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.094700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.095213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] PATH_INFO: `/v3/projects/7c5a101234584d2898729d670ad8c9d1/users/8317ddf2cc8d49fcb4ccda0413786b82/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.113785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5a101234584d2898729d670ad8c9d1, user_id=8317ddf2cc8d49fcb4ccda0413786b82, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:12.116840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:12.134820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1160/2336] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:11 2022] PUT /identity/v3/projects/7c5a101234584d2898729d670ad8c9d1/users/8317ddf2cc8d49fcb4ccda0413786b82/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:12.138779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.140459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.156681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5bb93-d16c-4d85-b38c-fbf0bcda9e55 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.177244 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:12.228535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb054c7-5d94-49e1-8e7e-31d71c5d8ea3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.233694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:12.234689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.234689 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.234859 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.235624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:12.239820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:12.240480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:12.241595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:12.243627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.244067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.244677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] PATH_INFO: `/v3/users/48751dca3f03458f8d07f6ac7d538566` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.246673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48751dca3f03458f8d07f6ac7d538566)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:12.250063 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:12.259712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1161/2337] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:12.260940 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.273103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f06a1-4af6-4c79-a785-95148c7c970c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.279475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:12.280313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.280590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.280907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] PATH_INFO: `/v3/projects/7c5a101234584d2898729d670ad8c9d1/users/8317ddf2cc8d49fcb4ccda0413786b82/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.284975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5a101234584d2898729d670ad8c9d1, user_id=8317ddf2cc8d49fcb4ccda0413786b82, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:12.289396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840acff8-1dda-4a56-bcb0-402f98efcdc0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:12.318467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1162/2338] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:12 2022] PUT /identity/v3/projects/7c5a101234584d2898729d670ad8c9d1/users/8317ddf2cc8d49fcb4ccda0413786b82/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:12.318724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48751dca3f03458f8d07f6ac7d538566'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.375220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.375797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.376149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.376278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48751dca3f03458f8d07f6ac7d538566'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.378125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48751dca3f03458f8d07f6ac7d538566'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.382295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48751dca3f03458f8d07f6ac7d538566'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.397828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48751dca3f03458f8d07f6ac7d538566'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:12.410695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] MFA Rules not processed for user `8317ddf2cc8d49fcb4ccda0413786b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:12.411969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.422320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1177/2339] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:12 2022] DELETE /identity/v3/users/48751dca3f03458f8d07f6ac7d538566 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:12.641805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1163/2340] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:12.654028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.655696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.813929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cedd28-8244-4f65-b425-d4f0b1e77c91 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.823427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:12.824751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:12.825488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:12.826186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:12.828880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:12.834901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.838422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:12.957336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:12.972734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1579b-edfa-4ccd-a1c0-39cf18c57b7c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:12.982593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:12.987116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9035d5b-19d0-430b-a80b-039eb1c96b81 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.004635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1178/2341] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:13.048857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.049567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.051817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.052164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] PATH_INFO: `/v3/projects/8d3f9376faaf4f349804a319c3fb27a9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.053405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d3f9376faaf4f349804a319c3fb27a9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.056174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.086640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:13.140409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d3f9376faaf4f349804a319c3fb27a9', 'request_id': 'req-e47bcd80-649c-4dfa-b176-647f94f3b018'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:13.150310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d3f9376faaf4f349804a319c3fb27a9', 'request_id': 'req-e47bcd80-649c-4dfa-b176-647f94f3b018'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:13.161430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d3f9376faaf4f349804a319c3fb27a9', 'request_id': 'req-e47bcd80-649c-4dfa-b176-647f94f3b018'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:13.174287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] The token cache is being invalidate because project 8d3f9376faaf4f349804a319c3fb27a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:13.174843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:13.175827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e47bcd80-649c-4dfa-b176-647f94f3b018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:13.177955 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1164/2342] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:12 2022] DELETE /identity/v3/projects/8d3f9376faaf4f349804a319c3fb27a9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:13.183828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.184117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.184397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.211164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:13.213250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:13.299541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1179/2343] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:13.307910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.308262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.308588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.343928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:13.345081 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:13.354485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1165/2344] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:13.359081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.372240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3a01-9157-4f43-93b7-914fd36539a4 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.382125 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.382750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.383032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.383300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.383984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:13.384293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.385993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.413352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1180/2345] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:39:13.419984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.431436 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d99374-96bb-4375-8d06-498fae1f531b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.445181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.446707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.447188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.447651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.448553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.453221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.513888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1166/2346] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:13 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:13.518249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.530797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650504-2b52-43a0-8fc8-db7387fdea5d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.604234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.604933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.605282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.605600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.606341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.608512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.639091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1181/2347] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:13 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:39:13.643344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.654244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbeed-66bb-4f7c-a113-8ad087136e6b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.658829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.659682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.659960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.660231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.660868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.662492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.672737 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1167/2348] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:13.676579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.686767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaedf93-32a6-4390-a7c9-7027491065f5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.691758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.692471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.692767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.693270 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.694231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.696515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58e204-8a93-4f06-8ea1-18eee7ee3b2d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.707962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1182/2349] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:13.712748 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.722763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2b941-5268-4e8e-bfa6-8c1d5b6931fc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.727911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.728556 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.728827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.729091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] PATH_INFO: `/v3/projects/a3a67e4f92574ffdb22004c096ae320f/users/56b3a443f8d2458f8017981169566166/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.744400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a67e4f92574ffdb22004c096ae320f, user_id=56b3a443f8d2458f8017981169566166, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.747141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.761239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1168/2350] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:13 2022] PUT /identity/v3/projects/a3a67e4f92574ffdb22004c096ae320f/users/56b3a443f8d2458f8017981169566166/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:13.771636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.771926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.772205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.800733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] MFA Rules not processed for user `56b3a443f8d2458f8017981169566166`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:13.802011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:13.851889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:13.877746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1183/2351] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:13.890655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:13.892346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:13.964070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eba45-04ac-4465-8f17-40a917ff75c3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:13.967845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:13.968447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:13.968826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:13.969101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:13.978521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:13.980002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:13.990444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1169/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:14.657950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:14.659762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:14.731567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:14.734774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43600ef-1876-45ec-8052-9018f01058b7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:14.739558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:14.740080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c78354-b957-4be1-bbd7-6629ef509cf0 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:14.740212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:14.740446 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:14.740724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] PATH_INFO: `/v3/users/91b49eebbc004ce0b0d752fd21cb17e9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:14.741862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b49eebbc004ce0b0d752fd21cb17e9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:14.743822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:14.743945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:14.744635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:14.744913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:14.745204 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:14.746896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:14.790120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:14.792604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b49eebbc004ce0b0d752fd21cb17e9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:14.802381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b49eebbc004ce0b0d752fd21cb17e9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:14.803009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b49eebbc004ce0b0d752fd21cb17e9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:14.803619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b49eebbc004ce0b0d752fd21cb17e9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:14.814230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:14.815932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57783517-250b-4b37-9245-fdaf00033f8f service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:14.817034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b49eebbc004ce0b0d752fd21cb17e9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:14.827732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1170/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:39:14.831072 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1184/2354] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:14 2022] DELETE /identity/v3/users/91b49eebbc004ce0b0d752fd21cb17e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:14.835235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:14.835516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:14.835784 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:14.855339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:14.856534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:14.916961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1171/2355] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:14.927437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:14.928870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:14.992377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32d9a-b4f1-4b3a-a5b7-1a30c74a893b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:14.996650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:14.997258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:14.997542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:14.997929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:15.008319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:15.010544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:15.021088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1185/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:15.351576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:15.354184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:15.377216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584574c-556d-4c6c-ae30-a09009b6fd52 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:15.394422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:15.395102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:15.395344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:15.395612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] PATH_INFO: `/v3/projects/0925838341db441f87a99b84c0e31fab` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:15.398647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0925838341db441f87a99b84c0e31fab)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:15.401394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:15.467403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0925838341db441f87a99b84c0e31fab', 'request_id': 'req-48e2830b-73e4-4cc9-bd83-02beeb136b06'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:15.478412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0925838341db441f87a99b84c0e31fab', 'request_id': 'req-48e2830b-73e4-4cc9-bd83-02beeb136b06'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:15.485854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0925838341db441f87a99b84c0e31fab', 'request_id': 'req-48e2830b-73e4-4cc9-bd83-02beeb136b06'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:15.500623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] The token cache is being invalidate because project 0925838341db441f87a99b84c0e31fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:15.500961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:15.501822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:15.503775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1172/2357] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:15 2022] DELETE /identity/v3/projects/0925838341db441f87a99b84c0e31fab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:15.545526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:15.548406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:15.563981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:15.631776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddd652-3cca-4081-8c8c-0c81108b66ac service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:15.690920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:15.691564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:15.691839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:15.692113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:15.693986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:15.759762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:15.761190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fdb1f-1ebb-4fb2-b99d-647c554747e7 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:15.770573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1186/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:19.435930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:19.437389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.509888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2830b-73e4-4cc9-bd83-02beeb136b06 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:19.514512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:19.515153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:19.515424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:19.515822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] PATH_INFO: `/v3/users/56b3a443f8d2458f8017981169566166` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:19.516967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b3a443f8d2458f8017981169566166)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:19.518991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:19.524685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:19.565958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b3a443f8d2458f8017981169566166'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.573616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b3a443f8d2458f8017981169566166'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.585147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b3a443f8d2458f8017981169566166'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.585841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b3a443f8d2458f8017981169566166'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.586431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b3a443f8d2458f8017981169566166'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.598493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1173/2359] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:19 2022] DELETE /identity/v3/users/56b3a443f8d2458f8017981169566166 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:19.603035 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:19.603526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:19.603628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:19.623339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:19.624666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.674652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:19.676059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.690067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1187/2360] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:19.705716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:19.707674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.729718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:19.746780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2ecf3-56bb-4dea-99b2-5522a08bada5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:19.752351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:19.752979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:19.753249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:19.753522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] PATH_INFO: `/v3/users/85faaf60dd194263871d0e6568b86a3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:19.754730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85faaf60dd194263871d0e6568b86a3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:19.756669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:19.775768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a45cab-03b4-49bd-ac9e-baa467bad359 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:19.781419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:19.782396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:19.782785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:19.783154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:19.795759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:19.797654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dce1e-0c79-4b50-ac04-9dd325a044a1 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:19.810104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1188/2361] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:19.810932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85faaf60dd194263871d0e6568b86a3f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.818309 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85faaf60dd194263871d0e6568b86a3f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.831969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85faaf60dd194263871d0e6568b86a3f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.832884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85faaf60dd194263871d0e6568b86a3f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.833577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85faaf60dd194263871d0e6568b86a3f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:19.849438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1174/2362] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:19 2022] DELETE /identity/v3/users/85faaf60dd194263871d0e6568b86a3f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:19.854694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:19.855066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:19.855369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:19.879272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:19.881041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.946742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1189/2363] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:19.956656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:19.958244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:19.965900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:20.023821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052151f7-89d1-4225-8ebe-21972cf60d3d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.027491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.028088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.028362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.028628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.037954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.039385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cbf15-82a0-4454-b3b6-4ec817301c4c service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.053950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1175/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:20.337695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.339226 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.351167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fe762-773f-4115-8e15-22abebc16265 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.356925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.357558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.357873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.358654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] PATH_INFO: `/v3/projects/a3a67e4f92574ffdb22004c096ae320f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.359449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a67e4f92574ffdb22004c096ae320f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.361353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.421082 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a67e4f92574ffdb22004c096ae320f', 'request_id': 'req-6a7696bc-42b7-4b34-ac9e-e740d758436e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.427597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a67e4f92574ffdb22004c096ae320f', 'request_id': 'req-6a7696bc-42b7-4b34-ac9e-e740d758436e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.436534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a67e4f92574ffdb22004c096ae320f', 'request_id': 'req-6a7696bc-42b7-4b34-ac9e-e740d758436e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.447110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] The token cache is being invalidate because project a3a67e4f92574ffdb22004c096ae320f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:20.447490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.448168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6a7696bc-42b7-4b34-ac9e-e740d758436e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.449949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1190/2365] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:20 2022] DELETE /identity/v3/projects/a3a67e4f92574ffdb22004c096ae320f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:20.454820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.455315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.455425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.476052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:20.478040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.549262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1176/2366] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:20.558088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.558371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.558641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.561943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.563958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.580460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628d256-784a-4704-b2e7-d76ace41a5f0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.587112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.587863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.588212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.589084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] PATH_INFO: `/v3/projects/34ca0ca2471a45769e755ffda2688f55` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.590533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ca0ca2471a45769e755ffda2688f55)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.592632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.596842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:20.598469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.609821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1191/2367] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:20.612193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.622016 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc67e7-7bb4-4aa3-a2b2-543f0421a270 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.627666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.628527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.628815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.629159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.629896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:20.630332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.632868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.657272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1192/2368] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:39:20.661788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.662212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ca0ca2471a45769e755ffda2688f55', 'request_id': 'req-5703ac23-8bca-4faf-9e5e-c37b0b39f689'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.672892 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3c3d6-bb01-42ec-96c4-d842b1cb902d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.675964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ca0ca2471a45769e755ffda2688f55', 'request_id': 'req-5703ac23-8bca-4faf-9e5e-c37b0b39f689'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.685982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ca0ca2471a45769e755ffda2688f55', 'request_id': 'req-5703ac23-8bca-4faf-9e5e-c37b0b39f689'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.703495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:20.708687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] The token cache is being invalidate because project 34ca0ca2471a45769e755ffda2688f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:20.709186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.711447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.714349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1177/2369] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:20 2022] DELETE /identity/v3/projects/34ca0ca2471a45769e755ffda2688f55 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:20.718183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.719721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.749979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.750589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.751190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.751190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.751756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.753663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.761336 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:20.786954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1193/2370] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:20 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:20.791667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.797650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:20.802003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ac23-8bca-4faf-9e5e-c37b0b39f689 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.871117 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79a730-91d2-4f28-adcf-9c66ed760df9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.875360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.875758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.875995 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.876278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.876374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.876554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] PATH_INFO: `/v3/users/0670b08a6016431cb4461c2a8f2c1fa2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.876649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.876865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.877489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.877697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0670b08a6016431cb4461c2a8f2c1fa2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.879433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.879631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.906577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1194/2371] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:20 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:20.912146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.922950 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a85d2e-995d-46d6-a647-0f32b19abc20 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.929168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.929882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.930228 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.930481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.931278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.933229 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.933961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0670b08a6016431cb4461c2a8f2c1fa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.945621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1195/2372] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:20.949583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0670b08a6016431cb4461c2a8f2c1fa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.950780 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.966334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530b1b3-1040-47eb-8f2e-b2f76c1bbaed admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:20.971141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:20.972022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:20.972622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:20.973332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:20.973884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:20.974565 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0670b08a6016431cb4461c2a8f2c1fa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.975488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0670b08a6016431cb4461c2a8f2c1fa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.976372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:20.976660 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1392afde-ac34-4b4a-9cff-bcd28cebce79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0670b08a6016431cb4461c2a8f2c1fa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:20.991657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1196/2373] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:20.996130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:20.997887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1178/2374] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:20 2022] DELETE /identity/v3/users/0670b08a6016431cb4461c2a8f2c1fa2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:20.998829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.016550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d26bc-d413-45f6-99e3-f41926fbca7f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.097844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.097844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.098116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.098369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] PATH_INFO: `/v3/projects/76a9f422201649a6b0628799f3ba621a/users/20419263a7944fcd84247a3dbe4c184d/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.114294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a9f422201649a6b0628799f3ba621a, user_id=20419263a7944fcd84247a3dbe4c184d, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.116938 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.125683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:21.132537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1197/2375] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:20 2022] PUT /identity/v3/projects/76a9f422201649a6b0628799f3ba621a/users/20419263a7944fcd84247a3dbe4c184d/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:21.143482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.143766 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.144041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.176819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] MFA Rules not processed for user `20419263a7944fcd84247a3dbe4c184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:21.178060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.237444 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:21.255838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1179/2376] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:21.257503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.304931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.307134 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.335813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca7e87-b18c-4da9-a7a8-7bab0ee33988 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.347234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.347962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.348733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.349007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.349670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.355088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.388951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22e8b-691e-4506-a796-a1fd8f370374 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.394250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.394872 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.395150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.395422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] PATH_INFO: `/v3/projects/b024e12e825741dd917f9d4f54348d1b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.396610 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b024e12e825741dd917f9d4f54348d1b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.398879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.403612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1198/2377] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:21 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:21.407547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.481064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b024e12e825741dd917f9d4f54348d1b', 'request_id': 'req-c2a92d50-d28b-4524-a8cf-75cd523f6915'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.494042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b59a3-f001-487a-9441-c45ffa2a3c49 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.500712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b024e12e825741dd917f9d4f54348d1b', 'request_id': 'req-c2a92d50-d28b-4524-a8cf-75cd523f6915'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.508632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b024e12e825741dd917f9d4f54348d1b', 'request_id': 'req-c2a92d50-d28b-4524-a8cf-75cd523f6915'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.529288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] The token cache is being invalidate because project b024e12e825741dd917f9d4f54348d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:21.529627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.534401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.536933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1180/2378] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:21 2022] DELETE /identity/v3/projects/b024e12e825741dd917f9d4f54348d1b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:21.542705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.544109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.578192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.579007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.579486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.579983 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.580882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.583201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.620644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1199/2379] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:21 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:21.626784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.628848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.642927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d2c5-57bb-42e1-aace-24cc027a6990 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.647731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.648403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.648745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.649127 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.649913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.651934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.660219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a92d50-d28b-4524-a8cf-75cd523f6915 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.667070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1200/2380] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:21.668050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.670260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.670900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.671182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.671486 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] PATH_INFO: `/v3/users/8317ddf2cc8d49fcb4ccda0413786b82` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.672647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8317ddf2cc8d49fcb4ccda0413786b82)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.674858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.678467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ace9d-f72f-4654-9685-d5b9bffd305e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.691854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.691854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.691854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.691854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] PATH_INFO: `/v3/projects/4049c797c9444fc98706316dd0d86faf/users/05a88ca48e0a48c593f91a906418c3bc/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.696846 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:21.714513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4049c797c9444fc98706316dd0d86faf, user_id=05a88ca48e0a48c593f91a906418c3bc, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.715453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:21.717884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.735457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1201/2381] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:21 2022] PUT /identity/v3/projects/4049c797c9444fc98706316dd0d86faf/users/05a88ca48e0a48c593f91a906418c3bc/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:21.740377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.754190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8317ddf2cc8d49fcb4ccda0413786b82'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.762034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8317ddf2cc8d49fcb4ccda0413786b82'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.774856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8317ddf2cc8d49fcb4ccda0413786b82'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.775588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8317ddf2cc8d49fcb4ccda0413786b82'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.776207 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8317ddf2cc8d49fcb4ccda0413786b82'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:21.791583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1181/2382] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:21 2022] DELETE /identity/v3/users/8317ddf2cc8d49fcb4ccda0413786b82 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:21.813099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fa026-c14c-490f-a6de-10a9a1f918c9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.881557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.882217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.882496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.882768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.883452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.885036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397647c1-788f-41bb-8323-471b582011fe admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.896008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1202/2383] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:21.900652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:21.902112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:21.915625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b50b75-269b-4114-acfb-54355a1f668f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:21.920217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:21.920791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.921064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.921327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] PATH_INFO: `/v3/projects/4049c797c9444fc98706316dd0d86faf/users/05a88ca48e0a48c593f91a906418c3bc/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.923224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4049c797c9444fc98706316dd0d86faf, user_id=05a88ca48e0a48c593f91a906418c3bc, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:21.925892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:21.945626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1182/2384] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:21 2022] PUT /identity/v3/projects/4049c797c9444fc98706316dd0d86faf/users/05a88ca48e0a48c593f91a906418c3bc/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:21.952828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:21.953143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:21.953410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:21.985028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] MFA Rules not processed for user `05a88ca48e0a48c593f91a906418c3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:21.986342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.063253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1203/2385] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:22.074234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.076059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.154870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94814b9-74cd-4027-ba67-5f4ad6d37ea6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.164553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.165337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.165715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.166251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.170628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.262585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.264456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0861c-48e6-471f-8507-bb78dc9a46ee service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.275375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.276845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.282779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1183/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:22.319113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:22.371313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6a645-ccfe-4d02-a671-7b87af614453 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.376108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.376731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.377009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.377283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] PATH_INFO: `/v3/projects/7c5a101234584d2898729d670ad8c9d1` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.378417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5a101234584d2898729d670ad8c9d1)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.380350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.433522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5a101234584d2898729d670ad8c9d1', 'request_id': 'req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:22.440866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5a101234584d2898729d670ad8c9d1', 'request_id': 'req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:22.448761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5a101234584d2898729d670ad8c9d1', 'request_id': 'req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:22.461295 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] The token cache is being invalidate because project 7c5a101234584d2898729d670ad8c9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:22.462245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:22.462882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f6504280-db9a-49e9-adb3-d41f0e4d5ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:22.464723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1204/2387] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:22 2022] DELETE /identity/v3/projects/7c5a101234584d2898729d670ad8c9d1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:22.470335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.470735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.471067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.494221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:22.495400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.529137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:22.560750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1184/2388] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:22.568365 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.568647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.568918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.589083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:22.590312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:22.599009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1205/2389] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:22.603202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.613498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7c5bf-6553-467a-ac57-172ed8004f7d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.621249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.621884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.622162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.622430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.623078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:22.623378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.624976 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.637476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1185/2390] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:39:22.641933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.651109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2202ba-4b29-489b-920a-6a06f0307620 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.655814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.656412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.656693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.656960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.657628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.659914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.687872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1206/2391] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:22 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:39:22.691903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.702598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195d910-7d3c-4ccd-ae87-3ee2e5dd97b5 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.763706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.764312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.764590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.764861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.765499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.767450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.788647 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1186/2392] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:22 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:22.792763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.802847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c43913-d9ba-432f-8561-af98d469bc44 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.807814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.808399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.808673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.808941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.809601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.811214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.822149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1207/2393] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:22.826000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.836225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f066dc-e78f-4dcf-ac67-aaa8488c9d69 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.841159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.841779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.842060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.842332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.842993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.844587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a71fb4-3833-475f-be35-4a608588b9bd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.856146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1187/2394] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:22.859778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:22.870501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae775edd-f0a7-4333-9d33-d8ed98fde286 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:22.875233 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:22.875885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.876149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.876413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] PATH_INFO: `/v3/projects/30e23c3f08274e5cac16fbb6756790a6/users/ed5a3a11043b4c3882d42f55d8e207cc/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.891582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e23c3f08274e5cac16fbb6756790a6, user_id=ed5a3a11043b4c3882d42f55d8e207cc, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:22.894236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:22.907534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1208/2395] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:22 2022] PUT /identity/v3/projects/30e23c3f08274e5cac16fbb6756790a6/users/ed5a3a11043b4c3882d42f55d8e207cc/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:22.919331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:22.919615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:22.919885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:22.947678 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] MFA Rules not processed for user `ed5a3a11043b4c3882d42f55d8e207cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:22.948858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:23.015756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1188/2396] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:23.027227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:23.028869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:23.071853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:23.087506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad287c-92d8-4c15-815d-002db031f18f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:23.091315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:23.091917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:23.092196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:23.092468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:23.101667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:23.103589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1593acc-11c2-4a08-a045-6f0bdb8c942c service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:23.113150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1209/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:24.856168 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:24.857635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:24.892611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:24.924617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4e01-af82-4cc1-93b9-b9fcae5fe6d6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:24.929220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:24.929938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:24.930241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:24.930512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] PATH_INFO: `/v3/users/20419263a7944fcd84247a3dbe4c184d` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:24.931629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20419263a7944fcd84247a3dbe4c184d)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:24.933606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:24.986268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20419263a7944fcd84247a3dbe4c184d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:24.993201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20419263a7944fcd84247a3dbe4c184d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.005047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20419263a7944fcd84247a3dbe4c184d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.005750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20419263a7944fcd84247a3dbe4c184d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.006367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20419263a7944fcd84247a3dbe4c184d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.021452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1189/2398] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:24 2022] DELETE /identity/v3/users/20419263a7944fcd84247a3dbe4c184d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:25.026691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:25.027323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:25.027323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:25.046802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:25.048017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:25.111008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1210/2399] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:25.121065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:25.123718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:25.203254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80d025-c2b7-4878-847a-7946dbf23490 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:25.209411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:25.210290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:25.210813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:25.211240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:25.224828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:25.226441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:25.238030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1190/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:25.517700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:25.519250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:25.531543 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196d316-a55c-4ad6-8cb9-967a003eb4fd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:25.536530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:25.537241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:25.537521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:25.537835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] PATH_INFO: `/v3/projects/76a9f422201649a6b0628799f3ba621a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:25.539083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a9f422201649a6b0628799f3ba621a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:25.540970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:25.587339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a9f422201649a6b0628799f3ba621a', 'request_id': 'req-6c8177d7-56aa-4ca5-b415-cf97739e4b09'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.593388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a9f422201649a6b0628799f3ba621a', 'request_id': 'req-6c8177d7-56aa-4ca5-b415-cf97739e4b09'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.601030 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a9f422201649a6b0628799f3ba621a', 'request_id': 'req-6c8177d7-56aa-4ca5-b415-cf97739e4b09'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.611338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] The token cache is being invalidate because project 76a9f422201649a6b0628799f3ba621a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:25.611628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.612252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.613720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1211/2401] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:25 2022] DELETE /identity/v3/projects/76a9f422201649a6b0628799f3ba621a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:25.618162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:25.628789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4768-496e-4964-9884-1550c6bcc978 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:25.691042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:25.706779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:25.707549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:25.708257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:25.708930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] PATH_INFO: `/v3/users/05a88ca48e0a48c593f91a906418c3bc` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:25.711320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a88ca48e0a48c593f91a906418c3bc)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:25.713688 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:25.775761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a88ca48e0a48c593f91a906418c3bc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.784662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a88ca48e0a48c593f91a906418c3bc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.801360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a88ca48e0a48c593f91a906418c3bc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.802159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a88ca48e0a48c593f91a906418c3bc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.802899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-a1248d63-512f-4046-813b-d6f777b8ffc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a88ca48e0a48c593f91a906418c3bc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:25.827061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1191/2402] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:25 2022] DELETE /identity/v3/users/05a88ca48e0a48c593f91a906418c3bc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:26.114788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.116221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:26.133696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8177d7-56aa-4ca5-b415-cf97739e4b09 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.190734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.191374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.191650 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.191919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] PATH_INFO: `/v3/projects/4049c797c9444fc98706316dd0d86faf` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.193036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4049c797c9444fc98706316dd0d86faf)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.195057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.202613 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:26.247864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4049c797c9444fc98706316dd0d86faf', 'request_id': 'req-91aabb9e-423c-4b1e-9789-abd3e75191b1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:26.254135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4049c797c9444fc98706316dd0d86faf', 'request_id': 'req-91aabb9e-423c-4b1e-9789-abd3e75191b1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:26.262206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4049c797c9444fc98706316dd0d86faf', 'request_id': 'req-91aabb9e-423c-4b1e-9789-abd3e75191b1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:26.274556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] The token cache is being invalidate because project 4049c797c9444fc98706316dd0d86faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:26.274859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:26.275475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-91aabb9e-423c-4b1e-9789-abd3e75191b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:26.277024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1212/2403] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:26 2022] DELETE /identity/v3/projects/4049c797c9444fc98706316dd0d86faf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:26.282010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.282496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.282608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.302452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:26.303659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:26.360814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1192/2404] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:26.368315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.368602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.368879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.388747 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:26.390000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:26.397964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1213/2405] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:26.402700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.412873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96261a-1e9c-4c74-bc6c-f0c7b757e6a6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.418717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.419408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.419747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.420020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.420679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:39:26.421004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.422598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.435016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1193/2406] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:39:26.438860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.448170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdada3b-ff46-43be-b2d0-18cfd027dc5e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.452826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.453416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.453689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.453994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.454622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.456526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.494588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1214/2407] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:26 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:39:26.495759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.505932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1009-6b68-43d5-8b08-2255d1870263 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.572061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.572758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.573102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.573437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.574170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.576171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.586067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:26.599963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1194/2408] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:26 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:26.604830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.614968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fca99-97a3-4fcd-a839-d0dcdfde3b8a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.619911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.620505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.620813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.621089 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.621811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.623452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.634287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1215/2409] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:26.638151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.648248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db788-2346-43c0-92d6-c0ad7a3a1657 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.653513 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.654143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.654423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.654696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.655331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.656914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbf58d-0a62-419a-b92b-ef5e2fc3a44c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.668164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1195/2410] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:39:26.672259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.683086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa2fc-d6ff-43e0-ae45-78c78585b425 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.687922 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.688519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.688843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.689116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] PATH_INFO: `/v3/projects/9885fdc5e46341419c901cf0ee89e977/users/36cabd08c00d4b9ab9c8e116870881fd/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.707614 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9885fdc5e46341419c901cf0ee89e977, user_id=36cabd08c00d4b9ab9c8e116870881fd, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.710347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.723345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1216/2411] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:26 2022] PUT /identity/v3/projects/9885fdc5e46341419c901cf0ee89e977/users/36cabd08c00d4b9ab9c8e116870881fd/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:39:26.728325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.728612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.728883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.747414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:26.748594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:26.805747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1196/2412] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:39:26.815293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:26.816956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:26.874871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84e81-2c74-44c3-9adb-1b07c531852d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:26.878618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:26.879225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:26.879503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:26.879778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:26.889415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:26.890858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59707-72f9-49ce-83d8-b90ad664cf1c service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:26.900894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1217/2413] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:28.190345 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:28.193514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:28.209669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78704c8-308b-4ca3-945e-235ed64f9757 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:28.217125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:28.218729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:28.219049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:28.219421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] PATH_INFO: `/v3/users/ed5a3a11043b4c3882d42f55d8e207cc` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:28.220683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5a3a11043b4c3882d42f55d8e207cc)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:28.222878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:28.298756 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5a3a11043b4c3882d42f55d8e207cc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:28.318818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5a3a11043b4c3882d42f55d8e207cc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:28.334073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5a3a11043b4c3882d42f55d8e207cc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:28.334948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5a3a11043b4c3882d42f55d8e207cc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:28.335618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5a3a11043b4c3882d42f55d8e207cc'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:28.365129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1197/2414] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:39:28 2022] DELETE /identity/v3/users/ed5a3a11043b4c3882d42f55d8e207cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:28.369378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:28.370141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:28.370141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:28.390860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:28.392575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:28.426311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:28.463558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1218/2415] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:28.473666 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:28.475396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:28.562057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a20c8f-3930-4af7-8fd3-726410f8b809 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:28.565870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:28.566482 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:28.566755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:28.567361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:28.583333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:28.585230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1578932-5a37-43e7-b1cc-6fea86883125 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:28.598449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:28.611638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1198/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:28.946669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:28.948456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:28.972864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6fe9b-5fac-4b94-81c3-90e740bb95b8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:28.981462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:28.982153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:28.982506 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:28.982848 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] PATH_INFO: `/v3/projects/30e23c3f08274e5cac16fbb6756790a6` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:28.984231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e23c3f08274e5cac16fbb6756790a6)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:28.995052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:29.052274 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e23c3f08274e5cac16fbb6756790a6', 'request_id': 'req-457df507-646e-45aa-b236-a4bfe99f15c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:29.063724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e23c3f08274e5cac16fbb6756790a6', 'request_id': 'req-457df507-646e-45aa-b236-a4bfe99f15c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:29.073852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e23c3f08274e5cac16fbb6756790a6', 'request_id': 'req-457df507-646e-45aa-b236-a4bfe99f15c9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:29.089664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] The token cache is being invalidate because project 30e23c3f08274e5cac16fbb6756790a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:39:29.090205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:29.091150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:39:29.093684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1219/2417] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:39:28 2022] DELETE /identity/v3/projects/30e23c3f08274e5cac16fbb6756790a6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:31.354076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.354538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.354538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.387037 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] MFA Rules not processed for user `36cabd08c00d4b9ab9c8e116870881fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:31.388523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:31.465932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1199/2418] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:31.470860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.472649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:31.562767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457df507-646e-45aa-b236-a4bfe99f15c9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.573151 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.573814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.574126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.574403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.575050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.576978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.609818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1220/2419] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:39:31 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:31.611245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.622774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accab8d-3c8f-4b3d-8798-85b1680017cd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.682727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.683504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.683887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.684236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.684959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.687030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.711225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1200/2420] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:39:31 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:39:31.715389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.726464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6efc89-0862-4c8c-9364-f2615b9dc055 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.731949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.732560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.732836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.733107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.733779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.735398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.746807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1221/2421] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:31.751260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.761381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edfd0-f0a1-4a21-a470-04f50258f267 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.766167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.766829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.767106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.767412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] PATH_INFO: `/v3/projects/6b602652938d4e1d8125c152f4dee00f/users/93d75d29152740cb9459b3c741123178/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.785062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b602652938d4e1d8125c152f4dee00f, user_id=93d75d29152740cb9459b3c741123178, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.787763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.802767 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1201/2422] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:31 2022] PUT /identity/v3/projects/6b602652938d4e1d8125c152f4dee00f/users/93d75d29152740cb9459b3c741123178/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:31.807534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.819068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ab6a7-fbfd-4774-b7a9-1e0c86cf8c91 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.851191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:31.888162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19167461-206c-458d-b223-9411ef453034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.888843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167461-206c-458d-b223-9411ef453034 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.889133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167461-206c-458d-b223-9411ef453034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.889406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19167461-206c-458d-b223-9411ef453034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.890096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167461-206c-458d-b223-9411ef453034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.892121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19167461-206c-458d-b223-9411ef453034 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.904735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1222/2423] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:39:31.908934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:31.926885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6648768-77d5-4e99-aa95-cc7775873dad admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:31.940146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:31.940883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:31.941089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:31.941360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] PATH_INFO: `/v3/projects/6b602652938d4e1d8125c152f4dee00f/users/93d75d29152740cb9459b3c741123178/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:31.947118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b602652938d4e1d8125c152f4dee00f, user_id=93d75d29152740cb9459b3c741123178, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:31.950849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0cc30-3204-4cfa-b8e1-1b6e72e5ed89 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:31.963035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1202/2424] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:39:31 2022] PUT /identity/v3/projects/6b602652938d4e1d8125c152f4dee00f/users/93d75d29152740cb9459b3c741123178/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:39:34.442919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:34.442919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:34.442919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:34.480656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] MFA Rules not processed for user `669bb3546dde473b81b0173b3a897d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:34.482164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:34.559361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1223/2425] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:37.764803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:37.765407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:37.765407 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:37.795424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] MFA Rules not processed for user `93d75d29152740cb9459b3c741123178`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:37.796693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:37.827567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:37.888175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1203/2426] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:37.902545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:37.904277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:37.989995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1c19-8f52-4bf2-9ff7-c7812236b22c None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:37.996745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:37.997355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:37.997634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:37.997940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:38.072224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:38.074045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e2276-6ac3-4fab-bcfd-3ceb99cbb12c service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:38.084257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1224/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:38.819777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:39:38.826681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:38.946996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4441712-26b4-4f9c-bd24-b99e1b03c37f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:39:38.951139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:39:38.951801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:38.952083 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:38.952574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:38.955070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:39.044501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:39:39.050889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4db2ea-e2dc-448d-b033-f3accf113e7a service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:39:39.068424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1204/2428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:39:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:39:40.486586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:39:40.488542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:39:40.489185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:39:40.570005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] MFA Rules not processed for user `36cabd08c00d4b9ab9c8e116870881fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:39:40.572987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:39:40.612214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1225/2429] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:39:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:39:49.058372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=67 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:39:50.530164 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:40:19.717596 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:19.718153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:19.718153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:19.737051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] MFA Rules not processed for user `da376f7be66d4e0c8467bb4a918a72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:19.738293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:19.794261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1205/2430] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:20.732801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:20.734571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:20.829496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87c7a-d08c-4f4c-8090-d8cbed4275e2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:20.834683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:20.836316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:20.837047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:20.837806 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:20.840293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:20.852785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:20.854741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54a4b-b43b-409c-8d11-22ea57e37d44 service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:20.868934 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1226/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:40:21.173924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:21.175363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:21.187686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38a1a8-f19e-4554-9149-d515b71139d3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:21.191456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:21.192049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:21.192327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:21.192597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:21.202347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:21.203771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:21.213107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1206/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:40:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:40:30.319175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63e3f-6479-416b-a2f4-ad2974ffe1bc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:30.320266 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63e3f-6479-416b-a2f4-ad2974ffe1bc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:30.320375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b63e3f-6479-416b-a2f4-ad2974ffe1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:30.340566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-67b63e3f-6479-416b-a2f4-ad2974ffe1bc None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:30.341791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-67b63e3f-6479-416b-a2f4-ad2974ffe1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:30.397723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1227/2433] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:30.440810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:30.442815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:30.528890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f4db-5bfd-4fdc-acc7-4941afae3b35 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:30.533980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:30.534586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:30.534865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:30.535395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:30.544372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:30.545993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b1c47-7e6c-48f0-bf24-e0c15958bf1d service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:30.555187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1207/2434] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:40:40.390754 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=57 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:40:40.551164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=63 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:40:45.777609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:45.778547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:45.778834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:45.780180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1228/2435] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:40:45.786714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0559-c723-4bd6-a8b5-7c606777679e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:45.787205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0559-c723-4bd6-a8b5-7c606777679e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:45.787312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d0559-c723-4bd6-a8b5-7c606777679e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:45.809123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0b8d0559-c723-4bd6-a8b5-7c606777679e None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:45.810357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0b8d0559-c723-4bd6-a8b5-7c606777679e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:45.819627 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1208/2436] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:45.832032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:45.833766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:45.891933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53835-c684-4a8f-bf40-e6a5a1b04ffd None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:45.895503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:45.896099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:45.896377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:45.896706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:45.907582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:45.908996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9958b9-a920-442c-92d6-8713fe53fd67 service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:45.920491 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1229/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:40:45.988403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8dc8-bb09-4cfb-83d0-281e2bcfbeaf None None] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:45.988679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8dc8-bb09-4cfb-83d0-281e2bcfbeaf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:45.988943 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c8dc8-bb09-4cfb-83d0-281e2bcfbeaf None None] PATH_INFO: `/` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:45.990373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1209/2438] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:40:45.995068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ed4e-68d8-4c74-9595-e9e69ca6ec43 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:45.995346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ed4e-68d8-4c74-9595-e9e69ca6ec43 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:45.995615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ed4e-68d8-4c74-9595-e9e69ca6ec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:46.015513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-e322ed4e-68d8-4c74-9595-e9e69ca6ec43 None None] MFA Rules not processed for user `ac90a40ddbfb4c79bc6941adb9498146`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:46.016721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e322ed4e-68d8-4c74-9595-e9e69ca6ec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:46.023816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1230/2439] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:46.036246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8dc8-bb09-4cfb-83d0-281e2bcfbeaf None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:46.047804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c8dc8-bb09-4cfb-83d0-281e2bcfbeaf None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:46.051383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:46.051971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:46.052242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:46.052506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:46.059735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:46.061169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d25989-530f-4759-b693-a547ac7a6155 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:46.068806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1210/2440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:40:46.152473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f95f-bff5-47a6-9fbe-9c20186a25a2 None None] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:46.152932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f95f-bff5-47a6-9fbe-9c20186a25a2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:46.153213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74f95f-bff5-47a6-9fbe-9c20186a25a2 None None] PATH_INFO: `/` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:46.154941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1231/2441] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 15:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 15:40:46.163097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27bdd-bf2a-49e7-9d82-efb0ed701a1c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:46.163379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27bdd-bf2a-49e7-9d82-efb0ed701a1c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:46.163651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27bdd-bf2a-49e7-9d82-efb0ed701a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:46.183982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2cd27bdd-bf2a-49e7-9d82-efb0ed701a1c None None] MFA Rules not processed for user `2ce045e8077e433ba889e189fb1c690b`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:46.185291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2cd27bdd-bf2a-49e7-9d82-efb0ed701a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:46.195797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1211/2442] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:46.206358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f95f-bff5-47a6-9fbe-9c20186a25a2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:46.218760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74f95f-bff5-47a6-9fbe-9c20186a25a2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:46.222478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:46.223071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:46.223384 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:46.223648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:46.233428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:46.234869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:46.245060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1232/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:40:49.036539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c465b-664f-4f48-bf7e-b3e11edccc4f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:49.037025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c465b-664f-4f48-bf7e-b3e11edccc4f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:49.037122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c465b-664f-4f48-bf7e-b3e11edccc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:49.057985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1e0c465b-664f-4f48-bf7e-b3e11edccc4f None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:40:49.059190 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1e0c465b-664f-4f48-bf7e-b3e11edccc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:40:49.066175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1212/2444] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:40:49.079601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:40:49.093284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3139-4e27-4c6f-8c45-71abe4e0bea6 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:40:49.100175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:40:49.100782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:40:49.101059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:40:49.101328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:40:49.109805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:40:49.111451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:40:49.119971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1233/2445] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:40:59.050644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=15 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:40:59.116190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=41 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:41:12.773536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96bf2-1444-4173-b332-0361a8377f56 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:41:12.774550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96bf2-1444-4173-b332-0361a8377f56 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:41:12.774721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f96bf2-1444-4173-b332-0361a8377f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:41:12.795243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-68f96bf2-1444-4173-b332-0361a8377f56 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:41:12.796480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-68f96bf2-1444-4173-b332-0361a8377f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:41:12.803566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1213/2446] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:41:12.815959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:41:12.826701 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb54cb1-302f-470a-bff6-d366bed43809 service swift] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:41:12.831690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:41:12.832220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:41:12.832497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:41:12.832768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:41:12.841408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:41:12.843028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:41:12.850814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1234/2447] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:41:22.789073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:41:22.847700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=6 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:41:58.636637 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:41:58.637144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:41:58.637144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:41:58.656024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] MFA Rules not processed for user `669bb3546dde473b81b0173b3a897d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:41:58.657202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:41:58.664197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1214/2448] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:41:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:42:08.650300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:42:17.026129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:17.036256 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a205a8-5ad0-4120-bbbd-47d1935ae661 service swift] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:17.040110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:17.040704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:17.040982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:17.041250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:17.043604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:17.057068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:17.058584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c6b54-d83a-4e8e-9476-9120ec9b55b8 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:17.069575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1235/2449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:42:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:42:19.334088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:19.343466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5c40f-7400-44d8-9e90-4e854f964f05 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:19.346944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:19.347536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:19.347815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:19.348084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:19.349961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:19.364485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:19.366070 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c607e-3d7f-4974-a407-dc45350d72df service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:19.377864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1215/2450] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:42:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:42:22.336253 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:22.336744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:22.336855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:22.356240 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] MFA Rules not processed for user `da376f7be66d4e0c8467bb4a918a72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:42:22.357447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:22.364232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1236/2451] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:42:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:42:29.372854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=6 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:42:30.162463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121901-c934-413d-bda4-406752d2d629 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:30.162750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121901-c934-413d-bda4-406752d2d629 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:30.163020 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121901-c934-413d-bda4-406752d2d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:30.181355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-15121901-c934-413d-bda4-406752d2d629 None None] MFA Rules not processed for user `8714c528b42f4b4c83c4d00dda783612`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:42:30.182575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-15121901-c934-413d-bda4-406752d2d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:30.236683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1216/2452] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:42:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:42:32.140826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:32.150485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d8483-4e1c-4e9c-a340-48e9d66e9fcf None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:32.154042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:32.154628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:32.154901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:32.155167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:32.156868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:32.168813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:32.170196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:32.179911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1237/2453] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:42:37.178441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121901-c934-413d-bda4-406752d2d629 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:37.191084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121901-c934-413d-bda4-406752d2d629 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:37.196429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:37.197023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:37.197300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:37.197571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:37.199333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:37.209387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:37.210987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70942981-5f22-40e5-b252-c8609e9040d5 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:37.220160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1217/2454] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:42:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:42:42.175025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=15 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:42:44.491465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:44.500697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4ad4b-fd3e-4ac4-a6f2-fc355d59c2b9 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:44.504648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:44.505345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:44.505671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:44.506176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:44.507899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:44.517703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:44.519261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:44.528367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1238/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:42:47.216259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=31 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:42:53.612434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:53.612973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:53.612973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:53.632023 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:42:53.633188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:42:53.640285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1218/2456] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:42:53.687405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:42:53.698726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395325f6-6aec-49de-9624-04d4e92160a7 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:42:53.703710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:42:53.704297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:42:53.704574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:42:53.704837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:42:53.712908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:42:53.715004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:42:53.722812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1239/2457] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:43:00.064455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:00.066040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:00.142621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7351f-2fb2-4188-80fb-80c759d3c1dc None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:00.147151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:00.147782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:00.148059 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:00.148330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] PATH_INFO: `/v3/users/a581b2094e964dc0bbec27582ea503e4` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:00.149970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a581b2094e964dc0bbec27582ea503e4)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:00.151902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:00.205228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a581b2094e964dc0bbec27582ea503e4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.212480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a581b2094e964dc0bbec27582ea503e4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.238371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a581b2094e964dc0bbec27582ea503e4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.239026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a581b2094e964dc0bbec27582ea503e4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.239623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a581b2094e964dc0bbec27582ea503e4'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.252553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1219/2458] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:43:00 2022] DELETE /identity/v3/users/a581b2094e964dc0bbec27582ea503e4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:00.423474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:00.435551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d9c1b-4a3d-4828-9707-a27f43f123c3 service swift] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:00.495457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:00.495987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:00.496776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:00.497047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] PATH_INFO: `/v3/projects/92ab8ec0a03f4354ac962e8fcb7d2de1` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:00.498205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ab8ec0a03f4354ac962e8fcb7d2de1)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:00.500081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:00.548329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ab8ec0a03f4354ac962e8fcb7d2de1', 'request_id': 'req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.554386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ab8ec0a03f4354ac962e8fcb7d2de1', 'request_id': 'req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.562843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ab8ec0a03f4354ac962e8fcb7d2de1', 'request_id': 'req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.572979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] The token cache is being invalidate because project 92ab8ec0a03f4354ac962e8fcb7d2de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:43:00.573263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.573918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.575962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1240/2459] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:43:00 2022] DELETE /identity/v3/projects/92ab8ec0a03f4354ac962e8fcb7d2de1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:00.579956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:00.581341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:00.594201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989dedb-8717-4b56-9ebe-40f65fc1ecd6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:00.650828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:00.651375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:00.651655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:00.651923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] PATH_INFO: `/v3/users/f18c129934cd42a08f86f3cebbbf583c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:00.653074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18c129934cd42a08f86f3cebbbf583c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:00.655035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:00.669717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:00.711396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18c129934cd42a08f86f3cebbbf583c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.718211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18c129934cd42a08f86f3cebbbf583c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.731076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18c129934cd42a08f86f3cebbbf583c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.732295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18c129934cd42a08f86f3cebbbf583c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.732898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18c129934cd42a08f86f3cebbbf583c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:00.745694 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1220/2460] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:43:00 2022] DELETE /identity/v3/users/f18c129934cd42a08f86f3cebbbf583c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:00.915617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:00.917130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:00.930739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48909d-c3a0-4b58-b7a0-dcf79f67b492 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:00.987589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:00.988208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:00.988490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:00.988764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] PATH_INFO: `/v3/projects/9bc836967f624e33b02b062e01fc42b4` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:00.989912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc836967f624e33b02b062e01fc42b4)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:00.991836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:00.998041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:01.039785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc836967f624e33b02b062e01fc42b4', 'request_id': 'req-d0151fa9-b5b0-4df1-9495-24da219891bb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:01.046328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc836967f624e33b02b062e01fc42b4', 'request_id': 'req-d0151fa9-b5b0-4df1-9495-24da219891bb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:01.053593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc836967f624e33b02b062e01fc42b4', 'request_id': 'req-d0151fa9-b5b0-4df1-9495-24da219891bb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:01.063542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] The token cache is being invalidate because project 9bc836967f624e33b02b062e01fc42b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:43:01.063824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:01.064445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:01.065942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1241/2461] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:43:00 2022] DELETE /identity/v3/projects/9bc836967f624e33b02b062e01fc42b4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:03.357651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:03.359085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:03.415818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2d97-d213-4c6f-bf23-89d4f4fa8a06 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:03.462307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:03.462906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:03.463180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:03.463451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:03.465139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:03.528936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:03.530409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:03.540545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1221/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:43:09.989042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:09.990630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:10.081672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0151fa9-b5b0-4df1-9495-24da219891bb admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:10.087989 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:10.088881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:10.089269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:10.089672 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:10.092015 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:10.107400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:10.109198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:10.122811 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1242/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:13.535476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:20.117855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:22.414247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:22.415617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:22.469831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdf6a0-5338-4b99-b68d-9fee35a79497 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:22.473302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:22.473920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:22.474195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:22.474460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:22.476126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:22.537600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:22.539303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:22.549321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1222/2464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:26.221453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:26.222998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:26.291501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:26.294255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:26.296763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1133f8-9c84-4472-b9f5-dcb4e7e080a9 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:26.302488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:26.303103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.303387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.303657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.305430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:26.307916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b36ea-3da1-4fc2-81de-fe0724e8bbff service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:26.312502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:26.313180 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.313540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.313911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] PATH_INFO: `/v3/users/669bb3546dde473b81b0173b3a897d0b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.315149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=669bb3546dde473b81b0173b3a897d0b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:26.317097 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:26.317220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:26.318743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:26.329011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1243/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:26.368412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669bb3546dde473b81b0173b3a897d0b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.375430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669bb3546dde473b81b0173b3a897d0b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.386922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669bb3546dde473b81b0173b3a897d0b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.388098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669bb3546dde473b81b0173b3a897d0b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.388703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23dfa47e-d4ce-4e3a-a49c-668a952b9a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669bb3546dde473b81b0173b3a897d0b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.401645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1223/2466] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:43:26 2022] DELETE /identity/v3/users/669bb3546dde473b81b0173b3a897d0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:43:26.570826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:26.583617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437bb1-b465-488a-827f-a689fab81071 service placement] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:26.654320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:26.655191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.655541 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.655883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] PATH_INFO: `/v3/projects/70debc9a37bd4c5cabddbb078adf86f0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.657101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70debc9a37bd4c5cabddbb078adf86f0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:26.660086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:26.734808 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70debc9a37bd4c5cabddbb078adf86f0', 'request_id': 'req-ebe2ed4a-782a-4387-89df-ff8b66505044'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.741250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70debc9a37bd4c5cabddbb078adf86f0', 'request_id': 'req-ebe2ed4a-782a-4387-89df-ff8b66505044'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.751013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70debc9a37bd4c5cabddbb078adf86f0', 'request_id': 'req-ebe2ed4a-782a-4387-89df-ff8b66505044'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.768739 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] The token cache is being invalidate because project 70debc9a37bd4c5cabddbb078adf86f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:43:26.769250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.770322 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ebe2ed4a-782a-4387-89df-ff8b66505044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:43:26.773020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1244/2467] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:43:26 2022] DELETE /identity/v3/projects/70debc9a37bd4c5cabddbb078adf86f0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:26.779317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.779795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.780135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.805991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:43:26.807490 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:26.828526 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:26.872851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1224/2468] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:43:26.880564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.880851 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.881139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.900410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:43:26.901611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:26.909336 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1245/2469] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:43:26.913807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:26.923967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562605a7-ae7a-4434-abf2-03df6264314f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:26.928506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:26.929097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.929378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.929651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.930347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:43:26.930652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:26.932236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:26.944223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1225/2470] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:43:26.948517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:26.957522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded10f1-a089-4aef-b98d-cf2ef9eb65cc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:26.962107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:26.962691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:26.962970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:26.963239 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:26.963868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:26.965764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:26.976779 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:26.994797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1246/2471] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:43:26 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:43:26.999507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:27.009118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d1b9d-6589-4903-90c7-2c17ed52df62 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:27.065114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:27.065779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.066066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.066364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.066986 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:27.068953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:27.091560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1226/2472] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:43:26 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:43:27.095787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:27.105988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9b060-bc63-4529-bfaf-45c04f15c84f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:27.111078 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:27.111670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.111951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.112224 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.112860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:27.114484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:27.124847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1247/2473] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:43:27.128641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:27.138330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919d2f0-484a-42ac-bebb-dc830bc5b57a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:27.142823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:27.143403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.143681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.143959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.144590 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:27.146206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0915d8f-3411-4bd9-b1b8-d645cac7e919 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:27.157027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1227/2474] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:43:27.160901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:27.171387 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110ee45-5938-497b-88fd-253808f6ca1d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:27.175927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:27.176564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.176842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.177115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] PATH_INFO: `/v3/projects/c733794058074008a6092098fc57c94e/users/2500a078012644c2862d9c17f914adf7/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.191201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c733794058074008a6092098fc57c94e, user_id=2500a078012644c2862d9c17f914adf7, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:27.193840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:27.206433 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1248/2475] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:43:27 2022] PUT /identity/v3/projects/c733794058074008a6092098fc57c94e/users/2500a078012644c2862d9c17f914adf7/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:43:27.211283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeb897-1521-423f-ac22-0f7637d2b401 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.211563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeb897-1521-423f-ac22-0f7637d2b401 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.211851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeb897-1521-423f-ac22-0f7637d2b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.230805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-41eeb897-1521-423f-ac22-0f7637d2b401 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:43:27.232614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-41eeb897-1521-423f-ac22-0f7637d2b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:27.289631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1228/2476] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:43:27.299713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:27.301425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:27.356829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb854375-b9ee-4f6a-9647-0160d8445404 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:27.360350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:27.360941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:27.361219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:27.361494 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:27.370237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:27.371644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:27.380956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1249/2477] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:31.945537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd006fc4-7a0b-4957-b0a3-c7e92c8bca03 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:31.946127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd006fc4-7a0b-4957-b0a3-c7e92c8bca03 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:31.946228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd006fc4-7a0b-4957-b0a3-c7e92c8bca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:31.976780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-fd006fc4-7a0b-4957-b0a3-c7e92c8bca03 None None] MFA Rules not processed for user `2500a078012644c2862d9c17f914adf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:43:31.978027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-fd006fc4-7a0b-4957-b0a3-c7e92c8bca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:31.995794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:32.050772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1229/2478] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:43:32.065153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:32.066627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:32.141714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a9a53-1328-4529-998a-978a187b9bfc service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:32.147221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:32.147825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:32.148107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:32.148380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:32.157194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:32.158815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:32.168467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1250/2479] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:33.468362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:33.468954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:33.469117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:33.489397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] MFA Rules not processed for user `2500a078012644c2862d9c17f914adf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:43:33.491082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:33.499775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1230/2480] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:43:33.842280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:33.852706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168f37-ec91-4ccb-8173-818e957c0ea1 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:33.860828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:33.861627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:33.862819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:33.863275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:33.865206 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:33.875998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:33.877420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:33.885782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1251/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:34.238743 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:34.244355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:34.362700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e90348-3d87-4f8f-a9b8-b64bb3e11e76 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:34.368151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:34.368834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:34.369504 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:34.369801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:34.371591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:34.386474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:34.388623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba12300-8da5-4d0d-aa2e-5119690eb10a service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:34.400110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1231/2482] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:37.511455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:43:37.513562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:37.532481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e991a-83e9-40fa-b172-d94e7926262e service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:43:37.538569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:43:37.539200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:43:37.539485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:43:37.539756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:43:37.541516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:43:37.558333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:43:37.560121 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43441c-40a8-4df6-a661-b08bd5cbfafb service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:43:37.583247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1252/2483] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:43:44.400174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=54 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:43:47.567824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:44:12.095603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:44:12.096096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:44:12.096096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:44:12.115529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] MFA Rules not processed for user `da376f7be66d4e0c8467bb4a918a72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:44:12.116734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:44:12.169957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1232/2484] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:44:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:44:22.162797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=25 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:44:26.134414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0d2a-2e41-42c3-847c-323532f92340 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:44:26.135006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0d2a-2e41-42c3-847c-323532f92340 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:44:26.135108 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0d2a-2e41-42c3-847c-323532f92340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:44:26.155040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fb3e0d2a-2e41-42c3-847c-323532f92340 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:44:26.156401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fb3e0d2a-2e41-42c3-847c-323532f92340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:44:26.215521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1253/2485] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:44:26.267257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:44:26.268706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:44:26.345602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32092f2-d7cf-4e1d-835e-ced615ea006a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:44:26.350539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:44:26.351152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:44:26.351428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:44:26.351704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:44:26.360639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:44:26.362252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:44:26.370451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1233/2486] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:44:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:44:36.208649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=25 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:44:36.367055 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=32 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:44:43.948080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d3ea-cfab-4ef7-84ea-affc65e8bc3c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:44:43.948554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d3ea-cfab-4ef7-84ea-affc65e8bc3c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:44:43.948655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40d3ea-cfab-4ef7-84ea-affc65e8bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:44:43.968017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8d40d3ea-cfab-4ef7-84ea-affc65e8bc3c None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:44:43.969193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8d40d3ea-cfab-4ef7-84ea-affc65e8bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:44:43.976101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1254/2487] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:44:43.988292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:44:43.998454 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26571718-d71c-45a0-898a-f3129f73c049 service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:44:44.003949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:44:44.004757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:44:44.005029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:44:44.005294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:44:44.013217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:44:44.014861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:44:44.022731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1234/2488] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:44:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:44:53.962804 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:44:54.019638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=6 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:07.486196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:07.486666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:07.486763 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:07.507520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:45:07.508703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:07.515617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1255/2489] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:45:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:45:07.527629 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:07.537904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a87a7b-efc2-42dd-9266-f349ae2fba1b service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:07.543024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:07.543605 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:07.543897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:07.544171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:07.552757 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:07.554362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:07.562882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1235/2490] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:45:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:45:17.502039 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:17.559002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=6 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:21.447119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:21.448557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:21.534019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793981c-c342-4801-8abd-f378d5242c9e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:21.538993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:21.539827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:21.540109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:21.540376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:21.542092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:21.552925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:21.554509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:21.564048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1256/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:45:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:45:31.560029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=37 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:33.822762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:33.824208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:33.867174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d04fb-9f1b-4d3b-a104-632f82f0a0bb service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:33.870794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:33.871387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:33.871662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:33.871930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:33.873673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:33.931124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:33.932536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:33.941245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1236/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:45:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:45:40.028559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:40.038332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc53db-af6f-4e74-b05b-82f551f7745a service placement] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:40.042179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:40.042766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:40.043040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:40.043308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:40.045009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:40.079760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:40.082331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:40.103719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1257/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:45:43.937303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=42 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:46.308471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:46.310043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:46.324853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190b500-25f4-48f2-b7a8-4926d8b42347 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:46.329426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:46.330188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:46.330464 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:46.330867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] PATH_INFO: `/v3/users/36cabd08c00d4b9ab9c8e116870881fd` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:46.331997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cabd08c00d4b9ab9c8e116870881fd)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:46.333949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:46.381778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cabd08c00d4b9ab9c8e116870881fd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.388720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cabd08c00d4b9ab9c8e116870881fd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.400659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cabd08c00d4b9ab9c8e116870881fd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.401340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cabd08c00d4b9ab9c8e116870881fd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.401969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cabd08c00d4b9ab9c8e116870881fd'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.414617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1237/2494] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:45:46 2022] DELETE /identity/v3/users/36cabd08c00d4b9ab9c8e116870881fd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:45:46.586604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:46.598137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e3f1-0ec6-4e1a-9c55-f17fe7f49987 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:46.654589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:46.655213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:46.655495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:46.655772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] PATH_INFO: `/v3/projects/9885fdc5e46341419c901cf0ee89e977` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:46.656868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9885fdc5e46341419c901cf0ee89e977)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:46.659338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:46.705180 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9885fdc5e46341419c901cf0ee89e977', 'request_id': 'req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.711424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9885fdc5e46341419c901cf0ee89e977', 'request_id': 'req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.719013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9885fdc5e46341419c901cf0ee89e977', 'request_id': 'req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.734179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] The token cache is being invalidate because project 9885fdc5e46341419c901cf0ee89e977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:45:46.734715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.735417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.740378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1258/2495] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:45:46 2022] DELETE /identity/v3/projects/9885fdc5e46341419c901cf0ee89e977 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:45:46.742370 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:46.744004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:46.757531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8442bf-1726-42b2-8175-b7d7a34d0331 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:46.829618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:46.830768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:46.831041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:46.831307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] PATH_INFO: `/v3/users/93d75d29152740cb9459b3c741123178` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:46.832433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93d75d29152740cb9459b3c741123178)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:46.834408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:46.885121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93d75d29152740cb9459b3c741123178'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.893162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93d75d29152740cb9459b3c741123178'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.910510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93d75d29152740cb9459b3c741123178'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.911253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93d75d29152740cb9459b3c741123178'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.911854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93d75d29152740cb9459b3c741123178'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:46.913969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:46.930901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1238/2496] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:45:46 2022] DELETE /identity/v3/users/93d75d29152740cb9459b3c741123178 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:45:47.350778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:47.352324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:47.366484 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc1f2e-fc62-44c0-9cab-15fa74dc798e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:45:47.417830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:47.430699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:45:47.431321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:45:47.431597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:45:47.431868 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] PATH_INFO: `/v3/projects/6b602652938d4e1d8125c152f4dee00f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:45:47.432976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b602652938d4e1d8125c152f4dee00f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:45:47.434887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:45:47.488482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b602652938d4e1d8125c152f4dee00f', 'request_id': 'req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:47.498022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b602652938d4e1d8125c152f4dee00f', 'request_id': 'req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:47.508920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b602652938d4e1d8125c152f4dee00f', 'request_id': 'req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:47.522764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] The token cache is being invalidate because project 6b602652938d4e1d8125c152f4dee00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:45:47.523113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:47.523886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:45:47.525393 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1259/2497] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:45:47 2022] DELETE /identity/v3/projects/6b602652938d4e1d8125c152f4dee00f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:45:56.928498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:57.518976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:45:59.933477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:45:59.934913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:45:59.992335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705b682-8421-4de9-b047-773bdf957356 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:00.038147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:00.038742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:00.039013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:00.039277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:00.041206 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:00.102612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:00.104121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:00.114307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1239/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:03.086774 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.088205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:03.142519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.144094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:03.157303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e53d7d-e790-43a5-bb09-2c18b2c79e21 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.162881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.163507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.163788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.164060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] PATH_INFO: `/v3/users/da376f7be66d4e0c8467bb4a918a72ab` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.165178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da376f7be66d4e0c8467bb4a918a72ab)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.167399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.183065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf27-2bad-4e43-9840-bf2e06acf5a8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.188814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.189415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.189692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.189993 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.191925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:03.205048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.206724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.217000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1260/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:03.217287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da376f7be66d4e0c8467bb4a918a72ab'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.225124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da376f7be66d4e0c8467bb4a918a72ab'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.230039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:03.242420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da376f7be66d4e0c8467bb4a918a72ab'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.243356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da376f7be66d4e0c8467bb4a918a72ab'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.243967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e240e143-bb58-4b52-9647-ee0829abadc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da376f7be66d4e0c8467bb4a918a72ab'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.260915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1240/2500] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:03 2022] DELETE /identity/v3/users/da376f7be66d4e0c8467bb4a918a72ab => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:03.433597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.447055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed19b-b3a9-4b62-b066-888b7380435f service placement] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.504708 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.505267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.505542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.505937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] PATH_INFO: `/v3/projects/d6e11b0f21324becb5916289dd584c0d` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.507118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e11b0f21324becb5916289dd584c0d)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.509534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.557501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e11b0f21324becb5916289dd584c0d', 'request_id': 'req-61dc16fa-86f4-4d2e-8a41-6c090321f58e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.563692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e11b0f21324becb5916289dd584c0d', 'request_id': 'req-61dc16fa-86f4-4d2e-8a41-6c090321f58e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.570482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e11b0f21324becb5916289dd584c0d', 'request_id': 'req-61dc16fa-86f4-4d2e-8a41-6c090321f58e'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.580535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] The token cache is being invalidate because project d6e11b0f21324becb5916289dd584c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:03.580817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.581970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-61dc16fa-86f4-4d2e-8a41-6c090321f58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:03.583432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1261/2501] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:03 2022] DELETE /identity/v3/projects/d6e11b0f21324becb5916289dd584c0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:03.588341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.588655 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.588931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.653650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:03.654897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:03.714321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1241/2502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:03.722176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.722468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.722748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.742200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:03.743402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:03.751193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1262/2503] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:03.755889 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.765235 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8c1f-bcc5-4984-84b9-6b38e51b1437 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.770242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.770821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.771098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.771364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.772000 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:03.772295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.773915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.785641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1242/2504] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:03.789962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.799085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2287a8-0ba9-45dc-bdda-268aa4403e0a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.803685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.804312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.804573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.804839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.805450 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.807370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.818648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:03.835953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1263/2505] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:03 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:03.840027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.849900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a61df-fb19-4a46-af52-b6f4060ba74e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.905025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.905646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.905952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.906224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.906868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.908770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.932813 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1243/2506] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:03 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:03.937091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.953048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fd19d-fd0e-4f51-b8b3-feb343837621 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:03.967906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:03.968538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:03.968814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:03.969080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:03.969769 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:03.971359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:03.981616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1264/2507] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:03.985806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:03.995574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb1b3-305b-49ae-b409-50e3fd7bb284 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:04.000284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:04.000868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:04.001140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:04.001405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:04.002062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:04.004137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91ccc0-cdee-4d6c-a9d5-8ecdf9a76638 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:04.014598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1244/2508] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:04.019615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:04.029607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b025dff-a7cb-42a0-8a8a-d45289bd7737 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:04.034194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:04.034825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:04.035103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:04.035369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] PATH_INFO: `/v3/projects/db882031e9d6405aab5ebd086f7259df/users/f5f8139adf904b91b3d80c62c3715a10/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:04.051011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db882031e9d6405aab5ebd086f7259df, user_id=f5f8139adf904b91b3d80c62c3715a10, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:04.053608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:04.067301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1265/2509] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:04 2022] PUT /identity/v3/projects/db882031e9d6405aab5ebd086f7259df/users/f5f8139adf904b91b3d80c62c3715a10/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:04.077438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:04.077750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:04.078057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:04.102664 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:04.106044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] MFA Rules not processed for user `f5f8139adf904b91b3d80c62c3715a10`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:04.107861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:04.171802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1245/2510] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:04.183685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:04.185429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:04.261458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8a240-bf04-45cf-af66-0b8699936f20 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:04.265134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:04.265676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:04.265986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:04.266262 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:04.274544 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:04.275960 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:04.285060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1266/2511] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:12.691212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:12.706359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:12.707907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:12.758869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27d79-ad7d-4301-89e4-24160ef13f36 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:12.763967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:12.764583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:12.764857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:12.765124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] PATH_INFO: `/v3/users/f5f8139adf904b91b3d80c62c3715a10` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:12.766199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3e5e-376c-4353-9f14-071591a84417 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:12.766334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f8139adf904b91b3d80c62c3715a10)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:12.768183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:12.769866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:12.770466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:12.770748 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:12.771021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:12.772854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:12.785330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:12.786790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e88320-6025-4099-93a9-7ea70d4b1c90 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:12.797325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1267/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:46:12.817452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f8139adf904b91b3d80c62c3715a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:12.824154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f8139adf904b91b3d80c62c3715a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:12.837618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f8139adf904b91b3d80c62c3715a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:12.838356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f8139adf904b91b3d80c62c3715a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:12.838964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f8139adf904b91b3d80c62c3715a10'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:12.852320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1246/2513] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:12 2022] DELETE /identity/v3/users/f5f8139adf904b91b3d80c62c3715a10 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:12.857247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:12.857592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:12.857948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:12.877353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:12.878637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:12.917190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:12.940154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1268/2514] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:12.949724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:12.951215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:12.977520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:13.012250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df5db8-8918-4401-95e7-9a56318cd163 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.015899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.016500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.016775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.017043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.026183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.027770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d94e7e-c471-4167-90a9-b649e86127c7 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.038167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1247/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:13.312182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.313844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:13.326693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502be02-0d75-4f91-a8be-2f9a69904081 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.332043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.332724 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.333064 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.333263 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] PATH_INFO: `/v3/projects/db882031e9d6405aab5ebd086f7259df` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.334522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db882031e9d6405aab5ebd086f7259df)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.336435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.383711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db882031e9d6405aab5ebd086f7259df', 'request_id': 'req-16f6ae8c-8981-44a1-a147-242f1b591f04'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:13.389797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db882031e9d6405aab5ebd086f7259df', 'request_id': 'req-16f6ae8c-8981-44a1-a147-242f1b591f04'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:13.398473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db882031e9d6405aab5ebd086f7259df', 'request_id': 'req-16f6ae8c-8981-44a1-a147-242f1b591f04'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:13.409864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] The token cache is being invalidate because project db882031e9d6405aab5ebd086f7259df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:13.410154 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:13.410787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-16f6ae8c-8981-44a1-a147-242f1b591f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:13.412269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1269/2516] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:13 2022] DELETE /identity/v3/projects/db882031e9d6405aab5ebd086f7259df => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:13.418979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.419270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.419563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.439010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:13.440827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:13.499226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1248/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:13.509597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.511216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.511216 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.530101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:13.531306 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:13.539297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1270/2518] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:13.543762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.553148 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8ef19-eecb-40ea-8159-0d657637477f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.557961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.558558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.558843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.559113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.559760 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:13.560067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.561697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.574789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1249/2519] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:13.579657 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.590028 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79bde4-336e-45b6-a79d-ab903a6cc28a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.595017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.595624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.595955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.596231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.596937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.598904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.630693 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1271/2520] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:13 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:13.631904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.642269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d453-0ad4-468b-bd5e-444d1e5fa716 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.710811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.711471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.711693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.711960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.712612 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.714580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.745989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1250/2521] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:13 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:46:13.750112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.761470 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e547c-45d3-4163-8b89-adf8d4c90d73 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.766364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.766979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.767257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.767526 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.768877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.770510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.781050 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1272/2522] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:46:13.784984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.795620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccaa4c-9dc7-4ef1-a5ab-f4dba3a2b503 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.801780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.802624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.803094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.803364 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.804016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.805618 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38705b9-b19a-4f0f-a136-0a3e0add9fc3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.821137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1251/2523] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:13.822341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.833540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcd762-692d-455f-8abb-a2273cf68fea admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:13.838632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:13.839329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.839678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.840024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] PATH_INFO: `/v3/projects/a505ca0380e54e72959e87ea1b95dd74/users/9b9b828ee4404b158c2310702108cfde/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.860817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a505ca0380e54e72959e87ea1b95dd74, user_id=9b9b828ee4404b158c2310702108cfde, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:13.864176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:13.878618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1273/2524] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:13 2022] PUT /identity/v3/projects/a505ca0380e54e72959e87ea1b95dd74/users/9b9b828ee4404b158c2310702108cfde/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:13.888825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:13.889112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:13.889386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:13.916720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] MFA Rules not processed for user `9b9b828ee4404b158c2310702108cfde`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:13.917870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:13.936774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:13.982807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1252/2525] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:13.994691 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:13.996361 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:14.055623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f14cd1-b772-4291-98c4-5b9dd49ae2ef admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:14.059447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:14.060045 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.060319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.060591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.069434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:14.070904 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e235e8-47ed-4be4-bad3-4794246cb679 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:14.079918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1274/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:14.099517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:14.167983 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e2ec-be2d-43ed-96c6-033aeb138c17 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:14.173074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:14.174295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.175010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.175258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] PATH_INFO: `/v3/users/9b9b828ee4404b158c2310702108cfde` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.176685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9b828ee4404b158c2310702108cfde)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:14.178663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:14.235398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9b828ee4404b158c2310702108cfde'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.244271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9b828ee4404b158c2310702108cfde'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.262575 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9b828ee4404b158c2310702108cfde'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.263400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9b828ee4404b158c2310702108cfde'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.264156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9b828ee4404b158c2310702108cfde'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.284716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1253/2527] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:14 2022] DELETE /identity/v3/users/9b9b828ee4404b158c2310702108cfde => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:14.286431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.286718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.287007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.296601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:14.310490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:14.313126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:14.377539 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1275/2528] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:14.388897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:14.390842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:14.440341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:14.457830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc97bc-cf83-4386-bf88-333a9f703d5c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:14.462869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:14.463682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.464439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.464439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.475090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:14.476535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253be904-47c8-400c-9686-c55ca41c806a service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:14.489198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1254/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:14.809202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:14.811510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:14.830380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb1243-9ee2-4a06-ab63-76e95ee0b8b3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:14.835994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:14.836624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.836935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.837208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] PATH_INFO: `/v3/projects/a505ca0380e54e72959e87ea1b95dd74` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.838390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a505ca0380e54e72959e87ea1b95dd74)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:14.840340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:14.890489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a505ca0380e54e72959e87ea1b95dd74', 'request_id': 'req-22f8a948-3c40-41a3-a473-b7a4373b73c8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.897260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a505ca0380e54e72959e87ea1b95dd74', 'request_id': 'req-22f8a948-3c40-41a3-a473-b7a4373b73c8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.905787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a505ca0380e54e72959e87ea1b95dd74', 'request_id': 'req-22f8a948-3c40-41a3-a473-b7a4373b73c8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.917363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] The token cache is being invalidate because project a505ca0380e54e72959e87ea1b95dd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:14.917675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.918324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-22f8a948-3c40-41a3-a473-b7a4373b73c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:14.919865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1276/2530] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:14 2022] DELETE /identity/v3/projects/a505ca0380e54e72959e87ea1b95dd74 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:14.925013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:14.925528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:14.925625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:14.946536 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:14.947791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:15.014149 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1255/2531] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:15.022502 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.022791 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.023073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.043225 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:15.044437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:15.052379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1277/2532] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:15.056635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.066771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22832-3cca-4e5b-b425-d5b9a9d933c7 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.071541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.072201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.072415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.072682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.073329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:15.073633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.075307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.088082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1256/2533] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:15.092673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.102146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f737232-1e3a-4077-99aa-90c3a23c007b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.106773 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.107366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.107647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.108212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.108530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.110455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.139033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1278/2534] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:15.142849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.155574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d73ab-b356-4b6d-b106-6452939310cd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.223064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.223701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.223978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.224243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.224883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.226909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.258868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1257/2535] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:15 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:46:15.260388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.291296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea1f65-26d8-44a9-a234-8ebbef4c109e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.296182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.296880 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.297220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.297561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.298293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.300482 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.310895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1279/2536] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:15.314933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.326142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c8f43-b551-406a-bd01-1f76fcbeace8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.333867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.334693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.335145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.335578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.336374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.338153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a2a9e-e452-4188-89e9-fd5aabc595d4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.350781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1258/2537] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:15.355047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.366530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4876-970f-4ee6-b761-e6959c380983 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.371815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.372607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.372971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.373528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] PATH_INFO: `/v3/projects/8a35db58954a49eaa9d1aafbd979d9f3/users/0b3fc68d4b7b429c956fbaa3567aa26c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.393081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a35db58954a49eaa9d1aafbd979d9f3, user_id=0b3fc68d4b7b429c956fbaa3567aa26c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.396087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.410865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1280/2538] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:15 2022] PUT /identity/v3/projects/8a35db58954a49eaa9d1aafbd979d9f3/users/0b3fc68d4b7b429c956fbaa3567aa26c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:15.422752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.423035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.423307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.451864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] MFA Rules not processed for user `0b3fc68d4b7b429c956fbaa3567aa26c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:15.452974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:15.492982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:15.522948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1259/2539] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:15.534508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.536294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:15.569936 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:15.607758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c691ddf-495f-4813-aaa3-2a96d4d600ce admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.612360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.613260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.613648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.617034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.630757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.632358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.645431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1281/2540] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:15.838815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:15.841397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:15.927427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa7c5f-18fa-4f00-b6d7-05d4622afaee None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:15.932127 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:15.932812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:15.933079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:15.933351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] PATH_INFO: `/v3/users/8714c528b42f4b4c83c4d00dda783612` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:15.934705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8714c528b42f4b4c83c4d00dda783612)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:15.936855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:15.995088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8714c528b42f4b4c83c4d00dda783612'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.002836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8714c528b42f4b4c83c4d00dda783612'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.015761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8714c528b42f4b4c83c4d00dda783612'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.016720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8714c528b42f4b4c83c4d00dda783612'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.017477 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-770e9b5d-9e89-431c-9251-75f434717400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8714c528b42f4b4c83c4d00dda783612'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.030418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1260/2541] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:15 2022] DELETE /identity/v3/users/8714c528b42f4b4c83c4d00dda783612 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:16.226805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.238166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15236f2e-fae2-4931-afc9-ee2edc9288d6 service glance] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.294626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.295249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.295528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.295841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] PATH_INFO: `/v3/projects/f9957599b78642099b02d15d5f9ffa0a` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.296955 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9957599b78642099b02d15d5f9ffa0a)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.298887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.349053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9957599b78642099b02d15d5f9ffa0a', 'request_id': 'req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.355549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9957599b78642099b02d15d5f9ffa0a', 'request_id': 'req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.363441 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9957599b78642099b02d15d5f9ffa0a', 'request_id': 'req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.374112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] The token cache is being invalidate because project f9957599b78642099b02d15d5f9ffa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:16.374397 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.375026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2b6e0059-22ed-4491-bcf0-8388c7ddb34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:16.376536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1282/2542] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:16 2022] DELETE /identity/v3/projects/f9957599b78642099b02d15d5f9ffa0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:16.381324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.381682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.382630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.402847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:16.404041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:16.453113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:16.463732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1261/2543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:16.471464 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.471749 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.472021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.491828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:16.493042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:16.501243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1283/2544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:16.506172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.516710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41b01-cdd8-43ca-bf33-60e67a19cf55 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.522984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.524254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.524534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.524804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.525456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:16.525786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.527378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.539775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1262/2545] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:16.544667 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.554286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe64e-a116-4805-b990-070845906fb3 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.559086 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.559697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.560000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.560276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.560914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.562970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.592073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1284/2546] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:16.596292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.606712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67402a-661e-4ab1-a3ef-3090d6d2ddb0 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.666731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.667360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.667634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.667903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.668538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.670475 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.692147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1263/2547] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:16.696568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.709860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666801b-e723-4740-8f6a-78dd50f8e746 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.714685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.715249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.715523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.715788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.716421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.718026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.728662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1285/2548] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:16.732826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.742672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbed989-5cf7-4bf6-a397-86c1e8f639c9 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.747476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.748085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.748366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.748635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.749323 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.750992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f728231-684e-4044-8976-ff5da3ef5875 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.763989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1264/2549] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:46:16.774719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:16.785099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b795-4b81-4af1-b78f-9167420cfb46 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:16.789834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:16.790799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.791143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.791479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] PATH_INFO: `/v3/projects/36482208972b4e0696f077f8158b0dc1/users/e77b8ff6788a4e938db72bd235cdedb0/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.807183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=36482208972b4e0696f077f8158b0dc1, user_id=e77b8ff6788a4e938db72bd235cdedb0, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:16.809926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:16.812213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:16.833350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1286/2550] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:16 2022] PUT /identity/v3/projects/36482208972b4e0696f077f8158b0dc1/users/e77b8ff6788a4e938db72bd235cdedb0/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:16.843751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:16.844058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:16.844328 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:16.876399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] MFA Rules not processed for user `e77b8ff6788a4e938db72bd235cdedb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:16.878146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:16.943376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1265/2551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:16.947878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.008633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b874f-21e5-4ebe-8b1d-152d69c2f7fa admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.013130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.013746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.014032 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.014325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.014954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.016844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.043527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1287/2552] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:17.048876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.061298 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a5a13-d288-4990-b6e6-40040ea2496e None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.107651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:17.117941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.118545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.118819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.119086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.119720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.121638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.141917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1266/2553] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:17 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:17.145982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.158337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c75c7-b208-43b3-8812-a3c0f88bb33b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.162937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.163698 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.163981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.164250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.164888 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.166789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.178221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1288/2554] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:17.182468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.192933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205208c-0e9d-474b-a3c3-4a2bd0481b8b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.197493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.198177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.198452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.198720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] PATH_INFO: `/v3/projects/8b1a6892c5e94049a2c96ee229f07407/users/eb467e3cfff24e0288c62c64090a4c8b/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.214511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1a6892c5e94049a2c96ee229f07407, user_id=eb467e3cfff24e0288c62c64090a4c8b, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.217796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.232406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1267/2555] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:17 2022] PUT /identity/v3/projects/8b1a6892c5e94049a2c96ee229f07407/users/eb467e3cfff24e0288c62c64090a4c8b/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:17.236053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.247249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bc9ca-b055-44dc-a551-f75f4fea837f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.305847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.306367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.306642 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.306912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.307542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.309390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e012e3f-a4fb-4115-a856-1f5cce02ce36 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.319728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1289/2556] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:17.326697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.339343 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287e5b7-46d3-4c82-981c-9866a2a9b0f7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.343966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.344619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.344893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.345164 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] PATH_INFO: `/v3/projects/8b1a6892c5e94049a2c96ee229f07407/users/eb467e3cfff24e0288c62c64090a4c8b/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.347633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1a6892c5e94049a2c96ee229f07407, user_id=eb467e3cfff24e0288c62c64090a4c8b, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.350285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.360899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1268/2557] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:17 2022] PUT /identity/v3/projects/8b1a6892c5e94049a2c96ee229f07407/users/eb467e3cfff24e0288c62c64090a4c8b/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:17.373194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.373481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.373784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.400987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] MFA Rules not processed for user `eb467e3cfff24e0288c62c64090a4c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:17.402210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:17.453606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:17.473099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1290/2558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:17.483709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:17.485401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:17.544116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2566b-7db5-48cb-a60a-24b514aabe6a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:17.547682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:17.548280 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:17.548553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:17.548819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:17.558129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:17.559479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc3ea3-e95f-4b81-a7de-a37dc6d3c7a3 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:17.568580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1269/2559] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:18.162532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:18.224013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1501e-37c3-434b-a9d0-6bf09cdf70f2 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:18.228969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:18.229596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:18.229909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:18.230188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] PATH_INFO: `/v3/users/e77b8ff6788a4e938db72bd235cdedb0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:18.231325 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77b8ff6788a4e938db72bd235cdedb0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:18.233314 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:18.284160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77b8ff6788a4e938db72bd235cdedb0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.292298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77b8ff6788a4e938db72bd235cdedb0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.292903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77b8ff6788a4e938db72bd235cdedb0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.293542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77b8ff6788a4e938db72bd235cdedb0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.306107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77b8ff6788a4e938db72bd235cdedb0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.318670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1291/2560] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:18 2022] DELETE /identity/v3/users/e77b8ff6788a4e938db72bd235cdedb0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:18.323160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:18.323830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:18.323994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:18.344527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:18.346108 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:18.408808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1270/2561] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:18.418661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:18.420057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:18.477942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985fee3-e57e-4a8b-aee7-99152d9437d2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:18.481582 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:18.482207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:18.482490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:18.482762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:18.492174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:18.493592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:18.503812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1292/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:18.786796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:18.788349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:18.802713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef02c5-83fb-4e7d-a01e-82762de13aca None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:18.807429 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:18.808086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:18.808383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:18.808653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] PATH_INFO: `/v3/projects/36482208972b4e0696f077f8158b0dc1` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:18.810026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=36482208972b4e0696f077f8158b0dc1)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:18.811830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:18.855991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:18.861115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36482208972b4e0696f077f8158b0dc1', 'request_id': 'req-568288d5-f5cf-4611-85d4-f3922c4c8b7d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.869273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36482208972b4e0696f077f8158b0dc1', 'request_id': 'req-568288d5-f5cf-4611-85d4-f3922c4c8b7d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.875530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36482208972b4e0696f077f8158b0dc1', 'request_id': 'req-568288d5-f5cf-4611-85d4-f3922c4c8b7d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.886033 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] The token cache is being invalidate because project 36482208972b4e0696f077f8158b0dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:18.886332 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.887060 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:18.888765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1271/2563] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:18 2022] DELETE /identity/v3/projects/36482208972b4e0696f077f8158b0dc1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:18.892883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:18.902729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383b8d2-996a-4f31-bc65-7165d373556f service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:18.910946 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:18.962190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:18.962894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:18.963184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:18.963460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] PATH_INFO: `/v3/users/eb467e3cfff24e0288c62c64090a4c8b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:18.964635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb467e3cfff24e0288c62c64090a4c8b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:18.966635 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.012534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb467e3cfff24e0288c62c64090a4c8b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.019458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb467e3cfff24e0288c62c64090a4c8b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.020085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb467e3cfff24e0288c62c64090a4c8b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.020689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb467e3cfff24e0288c62c64090a4c8b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.032525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9ac89040-e8c0-44c9-8311-1e5145a8437a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb467e3cfff24e0288c62c64090a4c8b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.045518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1293/2564] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:18 2022] DELETE /identity/v3/users/eb467e3cfff24e0288c62c64090a4c8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:19.328106 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.331101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:19.347511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568288d5-f5cf-4611-85d4-f3922c4c8b7d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.412210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.412744 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.413013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.413279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] PATH_INFO: `/v3/projects/8b1a6892c5e94049a2c96ee229f07407` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.414406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1a6892c5e94049a2c96ee229f07407)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.416566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.463518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1a6892c5e94049a2c96ee229f07407', 'request_id': 'req-9137193a-a3a7-4d7b-a6e0-66949f31ee93'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.470505 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1a6892c5e94049a2c96ee229f07407', 'request_id': 'req-9137193a-a3a7-4d7b-a6e0-66949f31ee93'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.476548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1a6892c5e94049a2c96ee229f07407', 'request_id': 'req-9137193a-a3a7-4d7b-a6e0-66949f31ee93'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.486929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] The token cache is being invalidate because project 8b1a6892c5e94049a2c96ee229f07407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:19.487217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.487841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-9137193a-a3a7-4d7b-a6e0-66949f31ee93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:19.489307 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1272/2565] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:19 2022] DELETE /identity/v3/projects/8b1a6892c5e94049a2c96ee229f07407 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:19.494190 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.494677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.494790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.515646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:19.516837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:19.575618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1294/2566] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:19.583840 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.584126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.584399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.603442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:19.604620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:19.612310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1273/2567] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:19.616304 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.625718 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735004d1-2177-4cfb-a9c4-ce8f1d06078f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.630973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.631559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.631837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.632106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.632743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:19.633049 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.634654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.648990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1295/2568] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:19.653453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.662827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6d2bd-fd2f-493b-ad63-9c6b1b7cf892 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.667553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.668132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.668422 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.668678 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.669293 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.671201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.699181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1274/2569] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:19 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:19.704608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.720171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da817b1-3fbb-433b-a48f-9e8ac2e819b7 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.742824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:19.783859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.784456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.784734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.785003 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.785620 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.787556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.808455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1296/2570] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:19 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:19.812529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.823619 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d1c28-d3e9-4c4f-9d03-6632229ce8f9 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.828460 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.829053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.829335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.829608 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.830286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.831879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.842234 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1275/2571] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:19.846948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.857135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313ba7-ddf2-4641-b5c2-1c542492898b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.861702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.862815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.863092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.863366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.864002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.865596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210e71a-9c9e-45df-95f5-5b0d05351a63 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.876368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1297/2572] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:19.881175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:19.891174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b1594-3934-4a4d-a454-f8a6c0406577 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:19.895789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:19.896424 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.896702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.896975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] PATH_INFO: `/v3/projects/a58c1c0b888f4118b2bef6fe8ee06a4c/users/b4449adf4d0a4fd78b8e6286d1b7cc2b/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.912430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58c1c0b888f4118b2bef6fe8ee06a4c, user_id=b4449adf4d0a4fd78b8e6286d1b7cc2b, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:19.915197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:19.923662 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:19.930158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1276/2573] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:19 2022] PUT /identity/v3/projects/a58c1c0b888f4118b2bef6fe8ee06a4c/users/b4449adf4d0a4fd78b8e6286d1b7cc2b/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:19.941879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:19.942219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:19.942437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:19.970719 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] MFA Rules not processed for user `b4449adf4d0a4fd78b8e6286d1b7cc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:19.971918 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:20.157799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1298/2574] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:20.162396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.225679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7ddc8-d55d-4076-9b7c-331a3eaeb952 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.230175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.230770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.231045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.231313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.231947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.233861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.259658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1277/2575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:20 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:20.263959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.274440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e953ba2-078b-4072-a6a1-dbfabab3df66 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.333046 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.333641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.333943 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.334211 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.334823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.336700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.357562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1299/2576] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:20 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:20.361783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.372428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeced9f8-60bf-48bf-92fd-5b86c4bbbb45 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.376982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.377640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.377952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.378230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.378884 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.380519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.392306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1278/2577] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:20.396678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.407432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312595a0-8c66-4135-92cf-2c9dbc930915 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.413080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.414040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.414417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.414793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] PATH_INFO: `/v3/projects/68d6efcaf510447480e77c415c6472d5/users/3a580a87f31c48549fbd4be5ea6abedd/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.429277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:20.433165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d6efcaf510447480e77c415c6472d5, user_id=3a580a87f31c48549fbd4be5ea6abedd, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.436112 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.451622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1300/2578] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:20 2022] PUT /identity/v3/projects/68d6efcaf510447480e77c415c6472d5/users/3a580a87f31c48549fbd4be5ea6abedd/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:20.455781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.466361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669998a-4368-4746-b22f-b0255a7a6f94 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.529817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.530652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.531027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.531376 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.532093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.534225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348eb9c-6ad7-4a40-9d19-b32397c6aa5f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.545176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1279/2579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:20.549951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.560332 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a29897-7cd3-4d40-bfac-4f4680b7add3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.567972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.567972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.567972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.567972 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] PATH_INFO: `/v3/projects/68d6efcaf510447480e77c415c6472d5/users/3a580a87f31c48549fbd4be5ea6abedd/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.568372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d6efcaf510447480e77c415c6472d5, user_id=3a580a87f31c48549fbd4be5ea6abedd, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.570859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.581625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1301/2580] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:20 2022] PUT /identity/v3/projects/68d6efcaf510447480e77c415c6472d5/users/3a580a87f31c48549fbd4be5ea6abedd/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:20.593056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.593372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.593648 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.621803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] MFA Rules not processed for user `3a580a87f31c48549fbd4be5ea6abedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:20.623052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:20.682724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:20.694330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1280/2581] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:20.706532 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.708189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:20.767347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb704c3c-5a5d-4804-bfd3-9d209b226712 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.771711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.772311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.772588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.772853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.781862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.783201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.793967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1302/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:20.865838 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:20.875518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b3cc2-11e1-4afc-b03c-a473ff4eb3e1 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:20.879071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:20.879654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:20.879932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:20.880240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:20.943440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:20.944906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58e1a3-8af2-4a8d-afb6-c1efce868c9f service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:20.953613 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1281/2583] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:21.256921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:21.321018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d488ab-a250-4744-bc19-e7f2b10c69a5 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:21.325317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:21.325967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:21.326237 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:21.326503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] PATH_INFO: `/v3/users/b4449adf4d0a4fd78b8e6286d1b7cc2b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:21.327835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4449adf4d0a4fd78b8e6286d1b7cc2b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:21.329753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:21.373201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4449adf4d0a4fd78b8e6286d1b7cc2b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.380026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4449adf4d0a4fd78b8e6286d1b7cc2b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.380649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4449adf4d0a4fd78b8e6286d1b7cc2b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.381247 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4449adf4d0a4fd78b8e6286d1b7cc2b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.392762 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4449adf4d0a4fd78b8e6286d1b7cc2b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.401915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:21.407297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1303/2584] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:21 2022] DELETE /identity/v3/users/b4449adf4d0a4fd78b8e6286d1b7cc2b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:21.413467 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:21.414062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:21.414062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:21.437587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:21.438847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:21.496120 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1282/2585] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:21.506406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:21.507867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:21.571001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4c83c-92de-4361-8ee0-2eb2134e78aa admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:21.574645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:21.575177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:21.575452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:21.575750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:21.584721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:21.586176 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:21.595611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1304/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:21.868384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:21.869876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:21.882022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5171c15-bad7-4bc3-a14e-a1f66a060703 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:21.886625 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:21.887252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:21.887531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:21.887805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] PATH_INFO: `/v3/projects/a58c1c0b888f4118b2bef6fe8ee06a4c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:21.888950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58c1c0b888f4118b2bef6fe8ee06a4c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:21.890900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:21.945418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58c1c0b888f4118b2bef6fe8ee06a4c', 'request_id': 'req-06f965d3-39dd-4702-b341-8159c3c51568'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.954964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58c1c0b888f4118b2bef6fe8ee06a4c', 'request_id': 'req-06f965d3-39dd-4702-b341-8159c3c51568'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.961479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58c1c0b888f4118b2bef6fe8ee06a4c', 'request_id': 'req-06f965d3-39dd-4702-b341-8159c3c51568'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.972446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] The token cache is being invalidate because project a58c1c0b888f4118b2bef6fe8ee06a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:21.972730 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.973396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:21.974917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1283/2587] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:21 2022] DELETE /identity/v3/projects/a58c1c0b888f4118b2bef6fe8ee06a4c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:21.978968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:21.989057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2588-f68e-45be-a742-50226e7e1907 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.046772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.047396 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.047674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.047951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] PATH_INFO: `/v3/users/3a580a87f31c48549fbd4be5ea6abedd` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.049107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a580a87f31c48549fbd4be5ea6abedd)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.051692 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.104743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a580a87f31c48549fbd4be5ea6abedd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.112469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a580a87f31c48549fbd4be5ea6abedd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.113026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a580a87f31c48549fbd4be5ea6abedd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.113640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a580a87f31c48549fbd4be5ea6abedd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.125812 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-f9fa6941-9e79-4f35-b5ea-6b8a02cb6164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a580a87f31c48549fbd4be5ea6abedd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.137921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1305/2588] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:21 2022] DELETE /identity/v3/users/3a580a87f31c48549fbd4be5ea6abedd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:22.407650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.409692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:22.423646 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f965d3-39dd-4702-b341-8159c3c51568 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.435418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:22.485847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.486497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.486772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.487041 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] PATH_INFO: `/v3/projects/68d6efcaf510447480e77c415c6472d5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.488159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d6efcaf510447480e77c415c6472d5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.490111 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.535894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d6efcaf510447480e77c415c6472d5', 'request_id': 'req-73a772bf-0676-4330-88ba-b00ce779fdb1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.543508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d6efcaf510447480e77c415c6472d5', 'request_id': 'req-73a772bf-0676-4330-88ba-b00ce779fdb1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.549929 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d6efcaf510447480e77c415c6472d5', 'request_id': 'req-73a772bf-0676-4330-88ba-b00ce779fdb1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.561679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] The token cache is being invalidate because project 68d6efcaf510447480e77c415c6472d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:22.561990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.562650 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-73a772bf-0676-4330-88ba-b00ce779fdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:22.564294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1284/2589] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:22 2022] DELETE /identity/v3/projects/68d6efcaf510447480e77c415c6472d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:22.569624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.569928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.570202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.589675 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:22.590887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:22.606743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:22.663915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1306/2590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:22.671980 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.672317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.672533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.703892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:22.705123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:22.713584 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1285/2591] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:22.717963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.727310 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a709c71-6d12-4460-9ba0-1d971ad156c1 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.731784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.732363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.732636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.732899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.733528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:22.733861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.735412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.750349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1307/2592] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:22.754426 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.763984 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943ac4d-9c7e-4552-93d1-aaac2018227c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.769187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.769800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.770076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.770342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.770961 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.772855 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.798497 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1286/2593] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:22 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:22.803232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.813083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affe17d-cb65-40c1-9cbd-5c90f0d0920c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.874094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.874721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.874996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.875268 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.875886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.878501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.899105 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1308/2594] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:22 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:22.903392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.913452 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de992e86-360c-48b4-bc24-4d0b71d61ea4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.918183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.918770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.919044 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.919311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.919939 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.921501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.932068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1287/2595] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:22.935730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.946478 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769dec-5904-4d4d-bb7c-175b4e03805b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.950994 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.951573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.951847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.952115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:22.952744 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:22.954339 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b248763-e36d-4d2c-8d98-9681ba88f888 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:22.967640 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1309/2596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:22.971692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:22.981787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6ff-0087-49c3-afaf-c532c0acbec4 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:22.986242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:22.987356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:22.987630 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:22.987896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] PATH_INFO: `/v3/projects/c6d6b185fd0b4e4f9b4a04fa9f72609f/users/b51f837e0c004647b663b0f27a28f1f9/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.002010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d6b185fd0b4e4f9b4a04fa9f72609f, user_id=b51f837e0c004647b663b0f27a28f1f9, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.005398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.018763 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1288/2597] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:22 2022] PUT /identity/v3/projects/c6d6b185fd0b4e4f9b4a04fa9f72609f/users/b51f837e0c004647b663b0f27a28f1f9/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:23.028980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.029265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.029536 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.058349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] MFA Rules not processed for user `b51f837e0c004647b663b0f27a28f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:23.059734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:23.125508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1310/2598] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:23.130675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.177982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:23.200074 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3ea23-4448-4143-82d7-93637360c354 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.204994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.205582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.205899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.206166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.206800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.208674 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.234480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1289/2599] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:23.239257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.249840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e27938-8371-4879-99ef-49d56d5a6184 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.261403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:23.309581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.310210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.310485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.310752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.311379 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.313264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.334260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1311/2600] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:23.338286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.348837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096d9c-92bc-49f7-b971-a62c82232767 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.353392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.354021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.354297 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.354567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.355199 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.356776 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.367722 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1290/2601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:23.371656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.383156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2ba86-417f-4264-942b-8601eaae14bc admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.389893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.390558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.390896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.391189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.391856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.393587 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87fe3-2fac-4da6-b1fe-6182cdb3ed77 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.405607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1312/2602] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:23.410430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.421049 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69b98-4303-4653-b2eb-0f560d24c57c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.426549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.427191 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.427463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.427729 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] PATH_INFO: `/v3/projects/a42be07e24e5466a97ddc8498a36c5a5/users/665dca8614064415b57473707f797b94/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.442654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42be07e24e5466a97ddc8498a36c5a5, user_id=665dca8614064415b57473707f797b94, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.445231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.458103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1291/2603] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:23 2022] PUT /identity/v3/projects/a42be07e24e5466a97ddc8498a36c5a5/users/665dca8614064415b57473707f797b94/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:23.469535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.469857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.470134 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.502425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] MFA Rules not processed for user `665dca8614064415b57473707f797b94`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:23.503820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:23.571755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1313/2604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:23.576405 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.648291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8603184-210f-4e67-82e1-78d248804184 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.652934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.653534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.653862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.654136 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.654778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.656724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.685778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1292/2605] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:23.690260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.716729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35d8e0-0662-474e-8fa8-9f6fbf7d1063 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.779600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.780658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.781149 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.781430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.782118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.785096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.817597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1314/2606] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:23 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:46:23.821554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.832435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd29872-4a15-4c1a-8d4b-df03f953c1fc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.837216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.837851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.838119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.838389 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.839064 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.840659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.852078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1293/2607] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:23.856296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.866431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d7e69-e7d7-4040-be51-3269943184ee admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.871258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.871903 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.872182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.872456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] PATH_INFO: `/v3/projects/8fdf3298e9b54821b63fa50f009502d0/users/3feb958fb9db4b7dab3f05d6de227aa2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.884403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:23.887932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdf3298e9b54821b63fa50f009502d0, user_id=3feb958fb9db4b7dab3f05d6de227aa2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.893720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.910962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1315/2608] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:23 2022] PUT /identity/v3/projects/8fdf3298e9b54821b63fa50f009502d0/users/3feb958fb9db4b7dab3f05d6de227aa2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:23.915030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:23.925357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7093ca7-a6c5-4e89-a9b8-e6df4e85df3a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:23.980899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:23.981508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:23.981812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:23.982087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:23.982728 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:23.984312 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656f73-d6a6-436a-bc3d-e88d38be50a9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:23.997555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1294/2609] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:23.998883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:24.012766 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bdee1-555d-49b7-9f23-961f5f758abf admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:24.018767 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:24.019434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:24.019707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:24.019974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] PATH_INFO: `/v3/projects/8fdf3298e9b54821b63fa50f009502d0/users/3feb958fb9db4b7dab3f05d6de227aa2/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:24.021947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdf3298e9b54821b63fa50f009502d0, user_id=3feb958fb9db4b7dab3f05d6de227aa2, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:24.025196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:24.035734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1316/2610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:23 2022] PUT /identity/v3/projects/8fdf3298e9b54821b63fa50f009502d0/users/3feb958fb9db4b7dab3f05d6de227aa2/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:24.046420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:24.046708 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:24.046985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:24.054366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:24.081325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] MFA Rules not processed for user `3feb958fb9db4b7dab3f05d6de227aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:24.083088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:24.155746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1295/2611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:24.167155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:24.168887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:24.229985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d165d-5241-4d4e-a8ce-93c3614a1407 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:24.233435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:24.234055 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:24.234331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:24.234597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:24.289940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:24.291860 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:24.302618 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1317/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:25.834252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:25.836755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:25.855147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6b3b8-b850-4bb4-85dc-4fa0f26f84fc None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:25.860919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:25.862459 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:25.862953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:25.863440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:25.926954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:25.928339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:25.938633 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1296/2613] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:26.479799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:26.489017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e51f9-dcdd-47fe-a8ca-2747637da7a5 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:26.492841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:26.493457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:26.493716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:26.494010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:26.503203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:26.504616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627ed12-f507-4379-9029-9bd6e4b60d1f service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:26.515220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1318/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:31.430543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:31.495340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae53da-95f3-44eb-ad9e-78d03d7f1242 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:31.499806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:31.500421 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:31.500698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:31.500969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] PATH_INFO: `/v3/users/b51f837e0c004647b663b0f27a28f1f9` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:31.502105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51f837e0c004647b663b0f27a28f1f9)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:31.504521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:31.652903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:31.670448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51f837e0c004647b663b0f27a28f1f9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:31.677334 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51f837e0c004647b663b0f27a28f1f9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:31.689144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51f837e0c004647b663b0f27a28f1f9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:31.690402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51f837e0c004647b663b0f27a28f1f9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:31.691018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51f837e0c004647b663b0f27a28f1f9'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:31.705203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1297/2615] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:31 2022] DELETE /identity/v3/users/b51f837e0c004647b663b0f27a28f1f9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:31.710219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:31.710716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:31.710824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:31.729079 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:31.730286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:31.786933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1319/2616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:31.796754 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:31.798205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:31.855514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb0b7e-5549-4e67-9074-b70e335cfd17 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:31.859104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:31.859698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:31.859973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:31.860247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:31.869494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:31.870949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:31.880641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1298/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:32.151388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:32.152866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:32.165019 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd98d8-c1ac-4917-abdf-6175afed2440 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:32.170065 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:32.170734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:32.170974 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:32.171241 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] PATH_INFO: `/v3/projects/c6d6b185fd0b4e4f9b4a04fa9f72609f` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:32.172505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d6b185fd0b4e4f9b4a04fa9f72609f)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:32.175275 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:32.194508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:32.225636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d6b185fd0b4e4f9b4a04fa9f72609f', 'request_id': 'req-797183a5-a1d0-4277-944c-0c2d2d97d3d8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.231844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d6b185fd0b4e4f9b4a04fa9f72609f', 'request_id': 'req-797183a5-a1d0-4277-944c-0c2d2d97d3d8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.239873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d6b185fd0b4e4f9b4a04fa9f72609f', 'request_id': 'req-797183a5-a1d0-4277-944c-0c2d2d97d3d8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.250182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] The token cache is being invalidate because project c6d6b185fd0b4e4f9b4a04fa9f72609f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:32.250448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.251066 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.252533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1320/2618] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:32 2022] DELETE /identity/v3/projects/c6d6b185fd0b4e4f9b4a04fa9f72609f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:32.256509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:32.265906 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8780f8-29ff-4b1a-932e-a10779952a58 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:32.319778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:32.320457 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:32.320733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:32.321002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] PATH_INFO: `/v3/users/665dca8614064415b57473707f797b94` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:32.322123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=665dca8614064415b57473707f797b94)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:32.324001 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:32.368864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665dca8614064415b57473707f797b94'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.370843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:32.378193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665dca8614064415b57473707f797b94'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.390039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665dca8614064415b57473707f797b94'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.390684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665dca8614064415b57473707f797b94'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.391272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665dca8614064415b57473707f797b94'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.403291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1299/2619] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:32 2022] DELETE /identity/v3/users/665dca8614064415b57473707f797b94 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:32.664144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:32.665664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:32.678524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797183a5-a1d0-4277-944c-0c2d2d97d3d8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:32.742445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:32.743103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:32.743377 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:32.743647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] PATH_INFO: `/v3/projects/a42be07e24e5466a97ddc8498a36c5a5` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:32.744743 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42be07e24e5466a97ddc8498a36c5a5)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:32.746674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:32.792413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42be07e24e5466a97ddc8498a36c5a5', 'request_id': 'req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.798356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42be07e24e5466a97ddc8498a36c5a5', 'request_id': 'req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.805977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42be07e24e5466a97ddc8498a36c5a5', 'request_id': 'req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.816179 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] The token cache is being invalidate because project a42be07e24e5466a97ddc8498a36c5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:32.816466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.817085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.818568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1321/2620] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:32 2022] DELETE /identity/v3/projects/a42be07e24e5466a97ddc8498a36c5a5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:32.822501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:32.823909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:32.836761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a4fb-f80b-4ea5-afef-b535dd60c10f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:32.890928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:32.891543 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:32.891821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:32.892090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] PATH_INFO: `/v3/users/3feb958fb9db4b7dab3f05d6de227aa2` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:32.893710 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3feb958fb9db4b7dab3f05d6de227aa2)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:32.895638 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:32.940578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3feb958fb9db4b7dab3f05d6de227aa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.947581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3feb958fb9db4b7dab3f05d6de227aa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.960498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3feb958fb9db4b7dab3f05d6de227aa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.961169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3feb958fb9db4b7dab3f05d6de227aa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.961949 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-4a18bd13-8904-4ce9-ace6-a516c3d8fe52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3feb958fb9db4b7dab3f05d6de227aa2'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:32.974369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1300/2621] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:32 2022] DELETE /identity/v3/users/3feb958fb9db4b7dab3f05d6de227aa2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:33.236688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.238289 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:33.257092 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d62ff5-cd2e-43b3-b04f-d3d7289750dd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.290679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:33.319829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.320382 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.320656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.320925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] PATH_INFO: `/v3/projects/8fdf3298e9b54821b63fa50f009502d0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.322080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdf3298e9b54821b63fa50f009502d0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.323940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.367783 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdf3298e9b54821b63fa50f009502d0', 'request_id': 'req-e6056359-a241-4108-80b1-6c3e2cb21287'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:33.373621 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdf3298e9b54821b63fa50f009502d0', 'request_id': 'req-e6056359-a241-4108-80b1-6c3e2cb21287'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:33.381346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdf3298e9b54821b63fa50f009502d0', 'request_id': 'req-e6056359-a241-4108-80b1-6c3e2cb21287'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:33.391337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] The token cache is being invalidate because project 8fdf3298e9b54821b63fa50f009502d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:33.391623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:33.392235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e6056359-a241-4108-80b1-6c3e2cb21287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:33.393666 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1322/2622] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:33 2022] DELETE /identity/v3/projects/8fdf3298e9b54821b63fa50f009502d0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:33.398920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.399205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.399480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.418658 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:33.419832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:33.460396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:33.479964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1301/2623] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:33.489273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.489564 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.489986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.510315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:33.511519 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:33.519345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1323/2624] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:33.523572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.533303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f80a38-d23c-4cc8-9d10-670f48173b49 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.537843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.538430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.538706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.538974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.539616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:33.539917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.541768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.553498 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1302/2625] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:33.557648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.567189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43275f3-33a3-4c14-9dcb-ed572d5938ce None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.571789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.572305 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.572579 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.572845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.573468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.575356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.601167 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1324/2626] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:33.605113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.615541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ccc22-81cc-459f-ab1a-2d2157ed56bc admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.670721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.671315 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.671592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.671864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.672494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.674913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.697785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1303/2627] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:33.702051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.712208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1052c-90d4-4956-bf64-0037edcbdbe9 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.716866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.717458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.717755 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.718047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.718684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.720265 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.730549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1325/2628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:33.734374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.744419 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35ab7-c7df-48e4-a0b1-75e9ca9ef15b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.749226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.749841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.750117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.750381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.751004 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.752592 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4a40d-1317-4aa9-9214-61c04a1908de admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.762184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1304/2629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:33.766158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.775897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74df35b-29c9-41cb-8a00-9876e0402a36 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.780410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.781057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.781338 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.781604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] PATH_INFO: `/v3/projects/1df094a14b6b4e0488f687913ae8ba10/users/d83b7f9f13d24a2a89fff9db95ec2389/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.799018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df094a14b6b4e0488f687913ae8ba10, user_id=d83b7f9f13d24a2a89fff9db95ec2389, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.802340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.815999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1326/2630] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:33 2022] PUT /identity/v3/projects/1df094a14b6b4e0488f687913ae8ba10/users/d83b7f9f13d24a2a89fff9db95ec2389/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:33.826715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.827241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.827241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.858861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] MFA Rules not processed for user `d83b7f9f13d24a2a89fff9db95ec2389`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:33.860058 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:33.922399 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1305/2631] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:33.927706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:33.987423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306516f-874b-473e-842c-e72dfb2ed8a3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:33.991996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:33.992581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:33.992859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:33.993132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:33.993759 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:33.995660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:33.999976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:34.025694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1327/2632] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:33 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:34.029769 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.041053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c6450-699d-4990-9e23-339b51d37b6a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.079577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:34.097750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.098353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.098628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.098895 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.099544 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.101433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.121445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1306/2633] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:34 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:34.125440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.135380 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a4b6-9bef-4d02-93d2-2b1bbaebc0ac admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.139835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.140412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.140685 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.140949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.141576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.143717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.153391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1328/2634] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:34.157597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.168310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d2fc-7100-4a64-b5d0-98e1eb51cdba admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.172916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.173518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.173824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.174135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.174775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.176537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5254-2834-4fbd-9d56-dfd49d4e0faa admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.190163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1307/2635] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:34.195817 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.206368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88af72-66f5-4c63-9d90-071dfc2981a0 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.215312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.215977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.216251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.216516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] PATH_INFO: `/v3/projects/c042d0dcf44b4b8c8e12d6cb16290440/users/ecddc02904714d41be8a72a0bbe9b981/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.231498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c042d0dcf44b4b8c8e12d6cb16290440, user_id=ecddc02904714d41be8a72a0bbe9b981, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.234143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.247463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1329/2636] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:34 2022] PUT /identity/v3/projects/c042d0dcf44b4b8c8e12d6cb16290440/users/ecddc02904714d41be8a72a0bbe9b981/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:34.258587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.258871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.259140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.287412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] MFA Rules not processed for user `ecddc02904714d41be8a72a0bbe9b981`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:34.288604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:34.354090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1308/2637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:34.358569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.418096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1b2dd-9ed5-4d9e-92e7-4b805c7f7b80 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.422707 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.423319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.423609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.423858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.424492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.426394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.451897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1330/2638] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:34 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:34.456696 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.468519 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524c65a-041b-4278-85cb-f17a64e6fa74 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.525465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.526119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.526396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.526669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.527348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.529246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.552223 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1309/2639] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:34 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:46:34.556486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.567138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c719-2af3-48ef-b5b0-38bd70fbd7b4 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.571735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.572316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.572595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.572867 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.573520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.575160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.586136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1331/2640] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:34.590854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.600558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e50e03-266e-40b2-a5e7-869923108389 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.605236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.605843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.606124 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.606392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] PATH_INFO: `/v3/projects/c767769fa0354650932fcc49cfd2c0e7/users/750d1ab485554050ad8ae31c689bff50/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.620401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c767769fa0354650932fcc49cfd2c0e7, user_id=750d1ab485554050ad8ae31c689bff50, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.623030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.635749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1310/2641] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:34 2022] PUT /identity/v3/projects/c767769fa0354650932fcc49cfd2c0e7/users/750d1ab485554050ad8ae31c689bff50/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:34.639734 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.650292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94705245-4b7a-4b7d-9801-7ce8bb83c6e2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.706008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.706609 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.706890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.707182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.707838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.709419 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf7bfc-2d66-43f4-b749-78f286079ccd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.718967 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1332/2642] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:34.723062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.733102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b7db-0ba5-4291-97bc-eabb46b34b71 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.737589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.738279 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.738555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.738822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] PATH_INFO: `/v3/projects/c767769fa0354650932fcc49cfd2c0e7/users/750d1ab485554050ad8ae31c689bff50/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.740885 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c767769fa0354650932fcc49cfd2c0e7, user_id=750d1ab485554050ad8ae31c689bff50, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.743535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:34.754005 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1311/2643] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:34 2022] PUT /identity/v3/projects/c767769fa0354650932fcc49cfd2c0e7/users/750d1ab485554050ad8ae31c689bff50/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:34.763997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.764284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.764560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.792200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] MFA Rules not processed for user `750d1ab485554050ad8ae31c689bff50`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:34.793400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:34.801913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:34.867725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1333/2644] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:34.879472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:34.881201 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:34.886462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:34.938616 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55e9a-81fc-41ca-ba38-01dfdaef9f39 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:34.942786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:34.943372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:34.943644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:34.943909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:34.997129 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:34.998577 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:35.007706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1312/2645] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:36.503250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:36.513182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a91b4-a660-480d-ae5f-4a41387ae431 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:36.516694 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:36.517281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:36.517560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:36.518025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:36.579927 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:36.581301 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694a679-11ca-4dfe-99db-8c4645543f3d service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:36.590043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1334/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:36.748848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:36.750537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:36.818302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e2ef-fb25-414a-a6c2-b856a657514f service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:36.823386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:36.824019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:36.824295 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:36.824570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] PATH_INFO: `/v3/users/0b3fc68d4b7b429c956fbaa3567aa26c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:36.825704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3fc68d4b7b429c956fbaa3567aa26c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:36.827663 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:36.879392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3fc68d4b7b429c956fbaa3567aa26c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:36.888002 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3fc68d4b7b429c956fbaa3567aa26c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:36.890019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:36.902882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3fc68d4b7b429c956fbaa3567aa26c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:36.903686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3fc68d4b7b429c956fbaa3567aa26c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:36.904350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3fc68d4b7b429c956fbaa3567aa26c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:36.919960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1313/2647] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:36 2022] DELETE /identity/v3/users/0b3fc68d4b7b429c956fbaa3567aa26c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:36.925173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:36.925457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:36.925765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:36.945367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:36.946608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.008945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1335/2648] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:37.015719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.017162 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.076465 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3808d-546b-4c5b-9650-7c2645d045a6 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.080146 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.081268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.081562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.081893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.090893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.092285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.102770 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1314/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:37.131552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.133018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.183592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:37.196448 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f961ba-aa10-4855-9b67-2bed629a4196 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.200203 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.200877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.201227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.201565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.203420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.268852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.270344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e62497-5f09-4b61-81a6-069e7a70381c service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.281005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1336/2650] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:37.405434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.406856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.420250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7d234-4f30-474b-9fee-bc4f6ff78966 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.424874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.425554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.425857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.426123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] PATH_INFO: `/v3/projects/8a35db58954a49eaa9d1aafbd979d9f3` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.427252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a35db58954a49eaa9d1aafbd979d9f3)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.429145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.478867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a35db58954a49eaa9d1aafbd979d9f3', 'request_id': 'req-d82fcabd-6df5-47e9-890e-01d64b04895d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:37.486807 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a35db58954a49eaa9d1aafbd979d9f3', 'request_id': 'req-d82fcabd-6df5-47e9-890e-01d64b04895d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:37.493603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a35db58954a49eaa9d1aafbd979d9f3', 'request_id': 'req-d82fcabd-6df5-47e9-890e-01d64b04895d'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:37.505826 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] The token cache is being invalidate because project 8a35db58954a49eaa9d1aafbd979d9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:37.506117 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:37.506753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-d82fcabd-6df5-47e9-890e-01d64b04895d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:37.508241 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1315/2651] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:37 2022] DELETE /identity/v3/projects/8a35db58954a49eaa9d1aafbd979d9f3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:37.513987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.514538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.514660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.536901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:37.538136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.597522 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1337/2652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:37.605273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.605561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.605899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.625119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:37.626348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:37.634562 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1316/2653] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:37.638646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.648580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1c17f-e883-4cb4-a7c4-76e7208c15ce None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.653646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.654259 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.654647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.654915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.655550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:37.655845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.657398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.669204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1338/2654] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:37.673449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.682586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb363d-e42e-442b-9388-b1be21e48fa0 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.687211 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.687835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.688109 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.688379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.689008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.691437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.719269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1317/2655] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:37 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:37.723632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.733576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4527245-8e0b-4600-9869-413bbf6c1f94 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.787658 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.788254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.788530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.788798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.789410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.791586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.812298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1339/2656] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:37 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:37.817032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.827088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bf131-19c2-4e93-857e-a75b765249ad admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.831715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.832300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.832579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.832848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.833480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.835097 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.844777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1318/2657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:37.848814 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.858569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becfcc2-1e67-464f-8875-37ab70f05a44 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.863695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.864281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.864556 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.864827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.865462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.867083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dfefe-0b12-498c-99d6-39aac3a23982 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.872152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:37.879021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1340/2658] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:37.882805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:37.892682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22546954-0fa7-4d91-9c85-9620fca2ef9c admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:37.897284 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:37.897952 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.898233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.898502 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] PATH_INFO: `/v3/projects/be46a2a1d39a4d3cb21d1b35411ba6a7/users/563761a03bd74c56b7e3ac6d288c6ee0/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.912566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be46a2a1d39a4d3cb21d1b35411ba6a7, user_id=563761a03bd74c56b7e3ac6d288c6ee0, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:37.915246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:37.923713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:37.930141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1319/2659] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:37 2022] PUT /identity/v3/projects/be46a2a1d39a4d3cb21d1b35411ba6a7/users/563761a03bd74c56b7e3ac6d288c6ee0/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:37.942715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:37.943099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:37.943440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:37.970414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] MFA Rules not processed for user `563761a03bd74c56b7e3ac6d288c6ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:37.971600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:38.033208 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1341/2660] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:38.044579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:38.046277 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:38.101516 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77526b-756d-4353-a0ed-370dd6bbca2e admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:38.104938 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:38.105523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:38.105833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:38.106126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:38.114626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:38.116029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcc00c-cffc-407b-9844-503cbee58b55 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:38.124466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1320/2661] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:46:41.152533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:41.154069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:41.222170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ead83-13e3-41a5-939d-5efb86c4cf4d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:41.226887 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:41.227507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:41.227776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:41.228042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] PATH_INFO: `/v3/users/d83b7f9f13d24a2a89fff9db95ec2389` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:41.229207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83b7f9f13d24a2a89fff9db95ec2389)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:41.231153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:41.275457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83b7f9f13d24a2a89fff9db95ec2389'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.282367 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83b7f9f13d24a2a89fff9db95ec2389'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.283007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83b7f9f13d24a2a89fff9db95ec2389'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.284102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83b7f9f13d24a2a89fff9db95ec2389'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.296168 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83b7f9f13d24a2a89fff9db95ec2389'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.308465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1342/2662] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:41 2022] DELETE /identity/v3/users/d83b7f9f13d24a2a89fff9db95ec2389 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:41.312883 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:41.313373 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:41.313480 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:41.331598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:41.332768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:41.389448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1321/2663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:41.399160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:41.400552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:41.411695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:41.458366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74dff8-15d5-4d4d-969b-085c7e1fd2fc admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:41.461901 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:41.462489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:41.462764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:41.463033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:41.472177 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:41.473649 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:41.482829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1343/2664] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:41.745503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:41.747063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:41.761197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846d4cf-8818-422f-8346-03b6a61e86c3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:41.766441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:41.767057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:41.767333 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:41.767635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] PATH_INFO: `/v3/projects/1df094a14b6b4e0488f687913ae8ba10` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:41.769287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df094a14b6b4e0488f687913ae8ba10)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:41.771118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:41.815919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df094a14b6b4e0488f687913ae8ba10', 'request_id': 'req-cab4d067-9fae-4414-b206-296a0cb20830'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.822642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df094a14b6b4e0488f687913ae8ba10', 'request_id': 'req-cab4d067-9fae-4414-b206-296a0cb20830'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.828863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df094a14b6b4e0488f687913ae8ba10', 'request_id': 'req-cab4d067-9fae-4414-b206-296a0cb20830'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.841881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] The token cache is being invalidate because project 1df094a14b6b4e0488f687913ae8ba10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:41.842165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.842831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.844281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1322/2665] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:41 2022] DELETE /identity/v3/projects/1df094a14b6b4e0488f687913ae8ba10 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:41.848730 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:41.858010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c63f-3516-4db8-8974-2354107258ba service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:41.917568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:41.918231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:41.918581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:41.918772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] PATH_INFO: `/v3/users/ecddc02904714d41be8a72a0bbe9b981` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:41.919871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecddc02904714d41be8a72a0bbe9b981)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:41.921836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:41.973525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecddc02904714d41be8a72a0bbe9b981'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.981214 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecddc02904714d41be8a72a0bbe9b981'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.981870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecddc02904714d41be8a72a0bbe9b981'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.982713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecddc02904714d41be8a72a0bbe9b981'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:41.995456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecddc02904714d41be8a72a0bbe9b981'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.008714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1344/2666] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:41 2022] DELETE /identity/v3/users/ecddc02904714d41be8a72a0bbe9b981 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:46:42.285485 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:42.287001 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:42.300474 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4d067-9fae-4414-b206-296a0cb20830 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:42.320706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:42.357897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:42.358522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:42.358798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:42.359072 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] PATH_INFO: `/v3/projects/c042d0dcf44b4b8c8e12d6cb16290440` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:42.360192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c042d0dcf44b4b8c8e12d6cb16290440)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:42.362636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:42.411197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c042d0dcf44b4b8c8e12d6cb16290440', 'request_id': 'req-ea04a6ed-c14e-451a-9b82-8f2a1603943b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.418233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c042d0dcf44b4b8c8e12d6cb16290440', 'request_id': 'req-ea04a6ed-c14e-451a-9b82-8f2a1603943b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.425294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c042d0dcf44b4b8c8e12d6cb16290440', 'request_id': 'req-ea04a6ed-c14e-451a-9b82-8f2a1603943b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.435673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] The token cache is being invalidate because project c042d0dcf44b4b8c8e12d6cb16290440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:42.435960 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.436600 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.438096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1323/2667] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:42 2022] DELETE /identity/v3/projects/c042d0dcf44b4b8c8e12d6cb16290440 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:42.442750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:42.444232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:42.457254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a1158-76a8-4cdf-ae3c-e20474a30ad8 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:42.487067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:42.518961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:42.519575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:42.519856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:42.520116 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] PATH_INFO: `/v3/users/750d1ab485554050ad8ae31c689bff50` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:42.521258 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750d1ab485554050ad8ae31c689bff50)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:42.523189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:42.569172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750d1ab485554050ad8ae31c689bff50'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.577430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750d1ab485554050ad8ae31c689bff50'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.578126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750d1ab485554050ad8ae31c689bff50'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.578731 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750d1ab485554050ad8ae31c689bff50'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.590538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4d5deb5e-cfb4-405c-b5ab-0c4a67281963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750d1ab485554050ad8ae31c689bff50'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:42.602261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1345/2668] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:42 2022] DELETE /identity/v3/users/750d1ab485554050ad8ae31c689bff50 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:42.870337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:42.871871 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:42.884989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a6ed-c14e-451a-9b82-8f2a1603943b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:42.943746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:42.944320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:42.944594 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:42.944864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] PATH_INFO: `/v3/projects/c767769fa0354650932fcc49cfd2c0e7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:42.945996 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c767769fa0354650932fcc49cfd2c0e7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:42.947879 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:42.994411 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c767769fa0354650932fcc49cfd2c0e7', 'request_id': 'req-ac8a69b6-8031-405f-857f-a772741a9c53'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:43.001904 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c767769fa0354650932fcc49cfd2c0e7', 'request_id': 'req-ac8a69b6-8031-405f-857f-a772741a9c53'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:43.003040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:43.011325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c767769fa0354650932fcc49cfd2c0e7', 'request_id': 'req-ac8a69b6-8031-405f-857f-a772741a9c53'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:43.023687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] The token cache is being invalidate because project c767769fa0354650932fcc49cfd2c0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:43.023979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:43.024715 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ac8a69b6-8031-405f-857f-a772741a9c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:43.026346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1324/2669] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:42 2022] DELETE /identity/v3/projects/c767769fa0354650932fcc49cfd2c0e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:43.031761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.032075 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.032429 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.053793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:43.055033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:43.114703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1346/2670] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:43.122982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.123266 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.123538 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.144752 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:43.146085 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:43.154700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1325/2671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:43.159793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.170284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd007-45fb-4069-9fd1-0751870616c7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.174964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.175549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.175824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.176091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.176761 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:43.177038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.178628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.190243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1347/2672] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:43.194876 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.203966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc146bf-be5c-4e97-b5b8-97e7683e58b1 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.209054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.209639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.209951 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.210222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.210830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.212734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.239263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1326/2673] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:43 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:43.243408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.253638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70e273-1223-48a3-8845-58522d254549 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.287615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:43.311982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.312576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.312855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.313123 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.313752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.315680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.336940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1348/2674] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:43 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:43.341071 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.351534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58817999-3143-4f7a-801e-2c66e61f6c38 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.356230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.356811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.357268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.357542 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.358200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.360160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.370290 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1327/2675] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:43.374198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.383768 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb88a5-12e2-4799-b3ac-346075450d26 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.388318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.388907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.389185 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.389454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.390124 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.391830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dff7f-6e94-4343-a527-ad5e9d6b6bac admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.403704 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1349/2676] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:43.407747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.418262 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596aaa3-09fc-49cd-952d-80c91cbc0e21 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.424890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.425550 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.425925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.426198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] PATH_INFO: `/v3/projects/3e3cdb44abaf42eb9664112faff10306/users/63bb5c5b0bc444c18e8e7e50ac283ce1/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.440991 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3cdb44abaf42eb9664112faff10306, user_id=63bb5c5b0bc444c18e8e7e50ac283ce1, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.443635 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.456734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1328/2677] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:43 2022] PUT /identity/v3/projects/3e3cdb44abaf42eb9664112faff10306/users/63bb5c5b0bc444c18e8e7e50ac283ce1/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:43.522885 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.523437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.523437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.550432 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] MFA Rules not processed for user `63bb5c5b0bc444c18e8e7e50ac283ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:43.551625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:43.611884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1350/2678] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:43.623598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:43.625249 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:43.680390 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4768882-4ea2-4da0-a94a-4002f85ed13f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:43.683933 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:43.684530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:43.684802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:43.685068 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:43.693803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:43.695226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3aa8e-291d-4915-90df-bf713fc2e5c9 service glance] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:43.703893 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1329/2679] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:46:51.687968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:51.688919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:51.756599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8264d5c-a77c-4b4f-90fa-ed11d1d5c276 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:51.761302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:51.762001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:51.762276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:51.762546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] PATH_INFO: `/v3/users/563761a03bd74c56b7e3ac6d288c6ee0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:51.763663 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=563761a03bd74c56b7e3ac6d288c6ee0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:51.765571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:51.813391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563761a03bd74c56b7e3ac6d288c6ee0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:51.815136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:51.821602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563761a03bd74c56b7e3ac6d288c6ee0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:51.822737 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563761a03bd74c56b7e3ac6d288c6ee0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:51.823454 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563761a03bd74c56b7e3ac6d288c6ee0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:51.835809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563761a03bd74c56b7e3ac6d288c6ee0'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:51.848516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1351/2680] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:46:51 2022] DELETE /identity/v3/users/563761a03bd74c56b7e3ac6d288c6ee0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:51.852970 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:51.853432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:51.853555 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:51.874219 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:51.875431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:51.946158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1330/2681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:51.953085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:51.954664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:52.014445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb787af5-f4c3-48fd-8cc0-126fa0d231ec admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.018109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.018714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.018987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.019254 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.029155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.030631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cada43a-ca63-45d3-8c06-eb059f813e07 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.042172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1352/2682] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:52.316819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.318271 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:52.331912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff94c8-9867-4e0b-aecf-a3cf5aa6d426 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.336897 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.337515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.337818 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.338092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] PATH_INFO: `/v3/projects/be46a2a1d39a4d3cb21d1b35411ba6a7` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.339192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be46a2a1d39a4d3cb21d1b35411ba6a7)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.342169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.365269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:52.395367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be46a2a1d39a4d3cb21d1b35411ba6a7', 'request_id': 'req-cd0c30d8-a027-4557-8987-dd79e51b515f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:52.402847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be46a2a1d39a4d3cb21d1b35411ba6a7', 'request_id': 'req-cd0c30d8-a027-4557-8987-dd79e51b515f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:52.409179 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be46a2a1d39a4d3cb21d1b35411ba6a7', 'request_id': 'req-cd0c30d8-a027-4557-8987-dd79e51b515f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:52.419425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] The token cache is being invalidate because project be46a2a1d39a4d3cb21d1b35411ba6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:46:52.419707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:52.420311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-cd0c30d8-a027-4557-8987-dd79e51b515f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:46:52.421780 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1331/2683] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:46:52 2022] DELETE /identity/v3/projects/be46a2a1d39a4d3cb21d1b35411ba6a7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:52.426596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.426875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.427189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.447166 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:52.448375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:52.507316 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1353/2684] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:52.515217 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.515500 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.515771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.538585 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:52.539781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:52.547771 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1332/2685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:52.553007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.563058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19062ad2-cacd-45f4-b784-baeed73f6b1a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.567746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.568342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.568622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.568896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.569538 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:46:52.569872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.571622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.590296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1354/2686] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:46:52.594958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.604287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c3728-0d5c-43fc-86de-c05a3c715f03 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.608804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.609381 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.609653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.609962 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.610580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.612461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.640210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1333/2687] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:46:52.645280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.655021 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac19551-e62e-4f25-b505-71359f5904cd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.706561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:52.716948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.717669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.718163 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.718601 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.719475 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.721378 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.742643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1355/2688] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:46:52 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:46:52.746812 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.757817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22af94-55fc-43c1-bbb8-1439cde6f823 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.763181 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.763794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.764140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.764320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.764966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.766583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.776932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1334/2689] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:52.781052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.790765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4eb8-e6df-45a6-a54d-67750270f64b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.795529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.796113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.796386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.796670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.797280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.798882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db634da0-36b6-4ea6-865f-22b615970985 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.809594 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1356/2690] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:46:52.813789 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.824434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2157d64-57a2-4ace-9fa1-954551524552 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:52.829027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:52.829676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.829985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.830260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] PATH_INFO: `/v3/projects/6aad7580eb1641d5b92bfb155f8383fa/users/f4dea34ad16540958b3321c7e5844700/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.844711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aad7580eb1641d5b92bfb155f8383fa, user_id=f4dea34ad16540958b3321c7e5844700, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:52.847440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:52.861809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1335/2691] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:46:52 2022] PUT /identity/v3/projects/6aad7580eb1641d5b92bfb155f8383fa/users/f4dea34ad16540958b3321c7e5844700/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:46:52.867752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7718-05b3-47cd-91d9-839928aabd5b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:52.868068 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7718-05b3-47cd-91d9-839928aabd5b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:52.868633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d7718-05b3-47cd-91d9-839928aabd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:52.888980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4d3d7718-05b3-47cd-91d9-839928aabd5b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:52.890193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4d3d7718-05b3-47cd-91d9-839928aabd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:52.947668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1357/2692] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:46:52.957263 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:52.958999 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:53.015351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a311b-f3a1-49f4-b4de-ff8be1203f45 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:53.018912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:53.019546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:53.019820 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:53.020090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:53.028799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:53.030259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:53.039472 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1336/2693] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:53.685540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0fbc-a93c-40c4-93be-818d3d59b49f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:53.685540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0fbc-a93c-40c4-93be-818d3d59b49f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:53.685540 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0fbc-a93c-40c4-93be-818d3d59b49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:53.712523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-ac1c0fbc-a93c-40c4-93be-818d3d59b49f None None] MFA Rules not processed for user `f4dea34ad16540958b3321c7e5844700`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:53.713877 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ac1c0fbc-a93c-40c4-93be-818d3d59b49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:53.787395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1358/2694] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:46:53.798368 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:46:53.799901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:53.855839 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:46:53.862382 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a2d08-a2a8-464e-a098-c88e0a9fb54e service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:46:53.870892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:46:53.871518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:53.871798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:53.872069 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:53.881602 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:46:53.883089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa32e77-fecf-446a-b682-88bace8207a5 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:46:53.891786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1337/2695] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:46:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:46:55.252303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:46:55.252855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:46:55.252956 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:46:55.272671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] MFA Rules not processed for user `f4dea34ad16540958b3321c7e5844700`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:46:55.273920 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:46:55.280714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1359/2696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:46:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:03.887835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:05.266684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:12.735339 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff108-661d-47f5-8a8e-09ad1460a2f8 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:12.735791 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff108-661d-47f5-8a8e-09ad1460a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:12.735905 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff108-661d-47f5-8a8e-09ad1460a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:12.755578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0aaff108-661d-47f5-8a8e-09ad1460a2f8 None None] MFA Rules not processed for user `f4dea34ad16540958b3321c7e5844700`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:12.756768 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0aaff108-661d-47f5-8a8e-09ad1460a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:12.763366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1338/2697] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:12.886002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:12.887447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:12.900772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba565f5-2b8a-4b64-b814-961567669bfc None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:12.905490 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:12.906234 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:12.906573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:12.906847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] PATH_INFO: `/v3/users/63bb5c5b0bc444c18e8e7e50ac283ce1` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:12.908189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bb5c5b0bc444c18e8e7e50ac283ce1)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:12.910202 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:12.958801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bb5c5b0bc444c18e8e7e50ac283ce1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:12.966947 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bb5c5b0bc444c18e8e7e50ac283ce1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:12.967711 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bb5c5b0bc444c18e8e7e50ac283ce1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:12.968354 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bb5c5b0bc444c18e8e7e50ac283ce1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:12.981420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bb5c5b0bc444c18e8e7e50ac283ce1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:12.994586 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1360/2698] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:47:12 2022] DELETE /identity/v3/users/63bb5c5b0bc444c18e8e7e50ac283ce1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:12.998975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:12.999257 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:12.999531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.001345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.002765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.018369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:13.019547 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.058942 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278dd23-c9c0-443e-a9c1-c54d6c714b7b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.062654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.063249 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.063520 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.063793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.065533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.074998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.076399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.077568 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1339/2699] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:13.085110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1361/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:47:13.087537 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.096811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d5d5f-6d91-476c-9377-89d1f2487fe4 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.100822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.101403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.101672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.101966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.111100 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.112499 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2326b-779d-4b58-bcd3-d2ae684792a7 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.121974 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1340/2701] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:13.511102 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.512875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.528736 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfeb6d-1314-456d-94e2-2970675f3c84 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.538615 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.540080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.540398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.540673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] PATH_INFO: `/v3/projects/3e3cdb44abaf42eb9664112faff10306` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.542294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3cdb44abaf42eb9664112faff10306)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.544398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.605612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3cdb44abaf42eb9664112faff10306', 'request_id': 'req-9a7e011e-7589-4c99-a55a-7b5f102e749b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:13.612853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3cdb44abaf42eb9664112faff10306', 'request_id': 'req-9a7e011e-7589-4c99-a55a-7b5f102e749b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:13.622933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3cdb44abaf42eb9664112faff10306', 'request_id': 'req-9a7e011e-7589-4c99-a55a-7b5f102e749b'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:13.630036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:13.636293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] The token cache is being invalidate because project 3e3cdb44abaf42eb9664112faff10306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:47:13.636655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:13.638897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-9a7e011e-7589-4c99-a55a-7b5f102e749b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:13.640756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1362/2702] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:47:13 2022] DELETE /identity/v3/projects/3e3cdb44abaf42eb9664112faff10306 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:13.645355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.645636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.645947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.665794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:13.667240 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.729075 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1341/2703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:13.737024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.737309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.737580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.758688 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:13.759605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:13.768503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1363/2704] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:13.773387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.783434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d191a-0f81-4d1f-8154-c680fd54b6c6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.788105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.788692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.788967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.789228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.789911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:47:13.790209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.792032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.804320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1342/2705] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:47:13.808706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.819252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd3871-182f-4cf1-bb57-e6c190dc285b None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.824243 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.824839 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.825115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.825383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.826047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.827996 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.869852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1364/2706] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:47:13 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:47:13.874119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.885007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11e3b-009e-496a-978c-33fa19294877 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.942077 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.942682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.942958 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.943227 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.944403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.946335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:13.962056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:13.969569 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1343/2707] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:47:13 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:47:13.974183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:13.985547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182c5e5-30d8-41e4-9658-a8abe01fe198 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:13.990346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:13.991593 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:13.991844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:13.992161 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:13.993651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:13.995389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:14.005562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1365/2708] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:47:14.010114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:14.020319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685d2f9-0d54-48dc-98f2-7c6c33964269 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:14.024779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:14.025366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:14.025639 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:14.025944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:14.026572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:14.028125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1d0b-6abb-4c28-b337-84c33cd39134 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:14.038522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1344/2709] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:47:14.042745 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:14.052676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284456-e733-4351-998d-0ad0fd6cd03b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:14.057752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:14.058425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:14.058703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:14.058971 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] PATH_INFO: `/v3/projects/232d2759ccae4d6bb7ec4e31428a1200/users/65915fac675a4b4da441551d8e8000d9/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:14.075525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232d2759ccae4d6bb7ec4e31428a1200, user_id=65915fac675a4b4da441551d8e8000d9, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:14.078347 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:14.093012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1366/2710] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:47:14 2022] PUT /identity/v3/projects/232d2759ccae4d6bb7ec4e31428a1200/users/65915fac675a4b4da441551d8e8000d9/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:47:14.105545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ebb2-b5b7-4e9c-b8c9-2efb82bd0c71 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:14.105914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ebb2-b5b7-4e9c-b8c9-2efb82bd0c71 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:14.106177 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ebb2-b5b7-4e9c-b8c9-2efb82bd0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:14.136790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b548ebb2-b5b7-4e9c-b8c9-2efb82bd0c71 None None] MFA Rules not processed for user `65915fac675a4b4da441551d8e8000d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:14.138135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b548ebb2-b5b7-4e9c-b8c9-2efb82bd0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:14.202656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1345/2711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:14.213959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:14.215700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:14.270445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef63e8-c373-4c8c-8cd3-909b82468d86 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:14.274551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:14.275141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:14.275417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:14.275686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:14.283726 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:14.285136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:14.294044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1367/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:15.661268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:15.661808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:15.662119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:15.682353 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] MFA Rules not processed for user `65915fac675a4b4da441551d8e8000d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:15.684558 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:15.695043 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1346/2713] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:18.099389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:18.101362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:18.155988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199e5d-22fe-46e6-9e1f-8c384a679ea0 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:18.159546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:18.160130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:18.160410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:18.160682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:18.162908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:18.204204 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:18.251353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:18.252777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24d49f-ec8a-4a6f-b173-a3fb6ab9c1fb service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:18.272853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1368/2714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:19.638644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:19.640159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:19.654967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b4dc-bbac-4106-a393-9324508e2752 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:19.658797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:19.659403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:19.659679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:19.659942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:19.661969 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:19.676796 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:19.678827 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:19.690383 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1347/2715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:28.269721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=26 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:29.685163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=47 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:33.741272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7035-b7de-4968-8ada-2216b0c9f1bf None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:33.741797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7035-b7de-4968-8ada-2216b0c9f1bf None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:33.741907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d7035-b7de-4968-8ada-2216b0c9f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:33.771381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a89d7035-b7de-4968-8ada-2216b0c9f1bf None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:33.773291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a89d7035-b7de-4968-8ada-2216b0c9f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:33.831604 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1369/2716] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:47:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:33.880394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:33.882506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:33.955123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df408a-2e92-48f4-9e5f-595a6090d82b service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:33.961423 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:33.962065 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:33.962734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:33.962734 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:33.971703 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:33.973291 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:33.982016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1348/2717] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:35.754231 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6353-2dcb-479f-a9b5-69e0cfcc5e94 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:35.754784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6353-2dcb-479f-a9b5-69e0cfcc5e94 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:35.754784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6353-2dcb-479f-a9b5-69e0cfcc5e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:35.775683 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5aac6353-2dcb-479f-a9b5-69e0cfcc5e94 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:35.776908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5aac6353-2dcb-479f-a9b5-69e0cfcc5e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:35.784637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1370/2718] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:47:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:35.801030 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:35.815920 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18026-e8d7-4de9-bf2a-1859fe1b24a9 service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:35.825967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:35.826937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:35.827449 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:35.827793 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:35.840836 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:35.842503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:35.856711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1349/2719] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:36.447818 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78b58-01ad-41f2-b7e7-25748e360f26 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:36.448178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78b58-01ad-41f2-b7e7-25748e360f26 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:36.448678 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78b58-01ad-41f2-b7e7-25748e360f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:36.470120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-21f78b58-01ad-41f2-b7e7-25748e360f26 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:36.471662 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-21f78b58-01ad-41f2-b7e7-25748e360f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:36.482757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1371/2720] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:36.502300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:36.515707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f36297-d9aa-4d4d-80a5-a5cb459f634b service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:36.538931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:36.539545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:36.539821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:36.540090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:36.557522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:36.559143 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:36.570928 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1350/2721] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:36.866391 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c32a1-d669-4803-a5fd-f9f1d0576d1c None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:36.866907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c32a1-d669-4803-a5fd-f9f1d0576d1c None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:36.866907 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c32a1-d669-4803-a5fd-f9f1d0576d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:36.891479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-169c32a1-d669-4803-a5fd-f9f1d0576d1c None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:36.892963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-169c32a1-d669-4803-a5fd-f9f1d0576d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:36.901386 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1372/2722] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:36.922747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:36.934888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2c5d6-1b12-4ece-8b04-303c36f28b28 service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:36.940573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:36.941282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:36.941559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:36.942076 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:36.951583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:36.953243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:36.965640 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1351/2723] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:37.337805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:37.338087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:37.338530 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:37.359588 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:37.360826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:37.368760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1373/2724] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:37.384841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:37.401790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b61bb-6880-4865-ad60-9074557cc3b0 service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:37.409782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:37.411132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:37.411430 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:37.412123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:37.424087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:37.425673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e245fb-f463-41c1-8f23-bb3c5cedb125 service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:37.438384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1352/2725] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:39.800674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:39.876205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332b2c6-f59c-4c52-8e16-d4cd52c68fb6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:39.882209 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:39.882874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:39.883150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:39.883445 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] PATH_INFO: `/v3/users/65915fac675a4b4da441551d8e8000d9` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:39.884595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=65915fac675a4b4da441551d8e8000d9)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:39.886592 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:39.956459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65915fac675a4b4da441551d8e8000d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:39.966218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65915fac675a4b4da441551d8e8000d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:39.966840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65915fac675a4b4da441551d8e8000d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:39.967460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65915fac675a4b4da441551d8e8000d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:39.984156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65915fac675a4b4da441551d8e8000d9'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:39.985352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:40.003852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1374/2726] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:47:39 2022] DELETE /identity/v3/users/65915fac675a4b4da441551d8e8000d9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:40.008140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.010786 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.011107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.033978 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:40.035186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:40.113342 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1353/2727] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:40.125853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.127398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:40.199394 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c86c2-2b6b-4980-8894-f66a086234ec admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.203213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.203815 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.204088 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.204356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.215284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.216702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4633dd-5598-487b-b0d2-45b4cf700742 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.229998 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1375/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:47:40.414794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.420294 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:40.435975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fd6e0-59fd-436f-a7d3-4c52ba952613 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.441435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.442580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.442580 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.442798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] PATH_INFO: `/v3/projects/232d2759ccae4d6bb7ec4e31428a1200` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.444711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232d2759ccae4d6bb7ec4e31428a1200)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.447783 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.498918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:40.513153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232d2759ccae4d6bb7ec4e31428a1200', 'request_id': 'req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:40.528103 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232d2759ccae4d6bb7ec4e31428a1200', 'request_id': 'req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:40.535432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232d2759ccae4d6bb7ec4e31428a1200', 'request_id': 'req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:40.548954 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] The token cache is being invalidate because project 232d2759ccae4d6bb7ec4e31428a1200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:47:40.549242 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:40.549926 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f0e8cd15-6172-4c0f-a63e-0e51c57ace27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:40.555183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1354/2729] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:47:40 2022] DELETE /identity/v3/projects/232d2759ccae4d6bb7ec4e31428a1200 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:40.557512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.558512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.558984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.580513 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:40.582915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:40.656926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1376/2730] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:40.667834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.668113 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.668378 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.692531 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:40.694762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:40.703675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1355/2731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:40.708212 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.721627 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e505144-b8f7-482c-af1c-2bbb89424e5a None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.726838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.727457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.727740 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.727982 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.728669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:47:40.728957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.730612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.744498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1377/2732] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 15:47:40.749461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.761011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb872de6-f062-414b-b038-dc583dcd3a66 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.766267 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.766896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.767173 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.767442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.768073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.770026 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.807374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1356/2733] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:47:40 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:47:40.811606 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.824467 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c08c-af55-49b8-9273-c15d59cd757f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.898465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.899128 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.899437 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.899823 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.900413 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.902637 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.936965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1378/2734] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:47:40 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:47:40.938329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.952846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d86464-e209-4110-bd91-1e9e6abc9544 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.958386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.958971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.959248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.960047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.960691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.962327 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:40.974048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1357/2735] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:47:40.978191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:40.990272 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8c94a-fd22-4b8a-81a3-a1569d9a32ab admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:40.994020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:40.994633 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:40.994925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:40.995311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:40.995959 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:40.997552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd9a77-f53c-494f-a7dd-1b908c914bed admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:41.000786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:41.013329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1379/2736] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:47:41.017489 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:41.032902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f6b9f-0bd4-4925-a0cb-bbcd9b316698 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:41.038335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:41.038971 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:41.039246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:41.039515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] PATH_INFO: `/v3/projects/949c78cebb8c48c1b47ce8e1c2593ffb/users/350000b9b7bd43199cfd94a9611f33e3/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:41.058372 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949c78cebb8c48c1b47ce8e1c2593ffb, user_id=350000b9b7bd43199cfd94a9611f33e3, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:41.062166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:41.081581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1358/2737] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:47:41 2022] PUT /identity/v3/projects/949c78cebb8c48c1b47ce8e1c2593ffb/users/350000b9b7bd43199cfd94a9611f33e3/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:41.084018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b436-d3e0-4550-81bf-3f1d4d8245ca None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:41.084156 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b436-d3e0-4550-81bf-3f1d4d8245ca None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:41.084616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b436-d3e0-4550-81bf-3f1d4d8245ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:41.108610 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-eb18b436-d3e0-4550-81bf-3f1d4d8245ca None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:41.110126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-eb18b436-d3e0-4550-81bf-3f1d4d8245ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:41.184641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1380/2738] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:41.207225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:41.210142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:41.279860 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7191b-fe38-4a10-bf5c-4496e01e0d92 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:41.284620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:41.285226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:41.285567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:41.285802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:41.296805 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:41.298288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:41.310202 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1359/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:42.042442 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd8cc-2dfb-4976-b960-46f3e556a313 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:42.042945 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd8cc-2dfb-4976-b960-46f3e556a313 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:42.043183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfd8cc-2dfb-4976-b960-46f3e556a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:42.075703 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-bbcfd8cc-2dfb-4976-b960-46f3e556a313 None None] MFA Rules not processed for user `350000b9b7bd43199cfd94a9611f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:42.076981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-bbcfd8cc-2dfb-4976-b960-46f3e556a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:42.162118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1381/2740] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:42.174832 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:42.177038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:42.251125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99234292-ba80-49e1-986a-23474dda0715 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:42.257574 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:42.258282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:42.258782 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:42.259028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:42.269053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:42.270548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:42.281275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1360/2741] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:43.697302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66318b8-67ce-477e-8b5b-927667b1593b None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:43.697859 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66318b8-67ce-477e-8b5b-927667b1593b None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:43.698230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66318b8-67ce-477e-8b5b-927667b1593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:43.720716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-a66318b8-67ce-477e-8b5b-927667b1593b None None] MFA Rules not processed for user `350000b9b7bd43199cfd94a9611f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:43.722159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-a66318b8-67ce-477e-8b5b-927667b1593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:43.732070 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1382/2742] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:46.512732 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:46.520642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:46.529166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43e95-7c6d-4f77-875a-910682b2fdd1 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:46.533622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:46.534420 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:46.535176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:46.535941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:46.538802 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:46.554507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:46.556801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:46.578170 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1361/2743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:47:49.536879 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:49.537328 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:49.537444 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:49.591511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] MFA Rules not processed for user `fd4760e8c6c54b748810f23da3bf3e01`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:49.592716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:49.643355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=100 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:49.654317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1383/2744] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 15:47:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:49.666435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:49.668051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:49.755302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82010b37-20d4-400f-a40e-d8f571bf7909 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:49.760717 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '504b251bfd13480a92e088d0f81d81ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:49.761302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:49.761582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:49.761881 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:49.769622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:49.771198 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:49.778901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1362/2745] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 15:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 15:47:51.943011 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:51.944535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:51.961337 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60093e9-02d2-4138-905a-f01196fb2b69 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:51.966951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:51.967585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:51.968595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:51.968595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] PATH_INFO: `/v3/users/f4dea34ad16540958b3321c7e5844700` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:51.969555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dea34ad16540958b3321c7e5844700)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:51.971525 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.021364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dea34ad16540958b3321c7e5844700'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.029893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dea34ad16540958b3321c7e5844700'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.030523 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dea34ad16540958b3321c7e5844700'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.031143 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dea34ad16540958b3321c7e5844700'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.044246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-240a9393-774b-4eda-a7f4-a109e49d1311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dea34ad16540958b3321c7e5844700'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.057350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1384/2746] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:47:51 2022] DELETE /identity/v3/users/f4dea34ad16540958b3321c7e5844700 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:52.232451 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.245788 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70fe2-f1f7-4151-9ef4-000749fb32cc service swift] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.301254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.301913 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.302187 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.302455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] PATH_INFO: `/v3/projects/6aad7580eb1641d5b92bfb155f8383fa` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.304130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aad7580eb1641d5b92bfb155f8383fa)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.306050 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.352923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aad7580eb1641d5b92bfb155f8383fa', 'request_id': 'req-e56c72c6-5057-4803-b0f2-1c37d8944a03'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.360268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aad7580eb1641d5b92bfb155f8383fa', 'request_id': 'req-e56c72c6-5057-4803-b0f2-1c37d8944a03'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.367098 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aad7580eb1641d5b92bfb155f8383fa', 'request_id': 'req-e56c72c6-5057-4803-b0f2-1c37d8944a03'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.368250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:52.379209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] The token cache is being invalidate because project 6aad7580eb1641d5b92bfb155f8383fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:47:52.379494 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.380123 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e56c72c6-5057-4803-b0f2-1c37d8944a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:47:52.381589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1363/2747] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:47:52 2022] DELETE /identity/v3/projects/6aad7580eb1641d5b92bfb155f8383fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:52.387479 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.387785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.388043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.407281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:52.408412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:52.465842 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1385/2748] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:52.474230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.474521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.475289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.495303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:52.496503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:52.504251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1364/2749] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:52.508366 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.518822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca951d-cb6d-447d-b57b-da3b2e285a35 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.523723 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.524320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.524598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.524870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.525511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:47:52.525854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.527438 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.539395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1386/2750] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:47:52.543908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.553541 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9c2fe-c93f-469c-a383-264e31eb8f3a None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.558167 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.558749 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.559029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.559300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.559925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.561922 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.590366 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1365/2751] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:47:52 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:47:52.594551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.605175 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831875c-6137-4548-8d5d-939c57eee26e admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.653401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:47:52.664277 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.665276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.665557 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.665845 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.666866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.668664 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.693119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1387/2752] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:47:52 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:47:52.697854 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.708197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450d681-e9eb-4a21-97ad-a7375c08fb1a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.713755 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.714352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.714631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.714902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.715559 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.717156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.727008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1366/2753] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:47:52.730966 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.741170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900145a-2d6b-4089-837d-40b1491c6dfd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.745751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.746497 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.746824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.747100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.747733 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.749350 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c904d-2aaa-48fa-8f67-c8d158c4a80b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.760480 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1388/2754] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:47:52.764496 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.774673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2640d-11dd-4020-99e1-8baa486e78aa admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.779586 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.780230 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.780511 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.780888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] PATH_INFO: `/v3/projects/5b62742e4bbe499c9b917507fd60ab3f/users/1809dea675e14780b5a5698417c70428/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.796517 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b62742e4bbe499c9b917507fd60ab3f, user_id=1809dea675e14780b5a5698417c70428, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:52.799193 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:52.815931 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1367/2755] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:47:52 2022] PUT /identity/v3/projects/5b62742e4bbe499c9b917507fd60ab3f/users/1809dea675e14780b5a5698417c70428/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:47:52.826852 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.827150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.827431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:52.855436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] MFA Rules not processed for user `1809dea675e14780b5a5698417c70428`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:47:52.856661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:52.922047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1389/2756] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:47:52.934139 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:47:52.935829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:47:52.991220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9bc8-45e6-4f7a-84e9-2a3fc95e23a7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:47:52.994809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:47:52.995398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:47:52.995676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:47:52.995948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:47:53.004027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:47:53.005437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e52d5-d76b-4e9e-b143-59207af89da9 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:47:53.015025 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1368/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:02.919153 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:03.011021 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:03.083120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:03.144060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141deed-38ef-4f18-8fe7-f986d3bf0579 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:03.148516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:03.149140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:03.149420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:03.149696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] PATH_INFO: `/v3/users/1809dea675e14780b5a5698417c70428` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:03.150838 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1809dea675e14780b5a5698417c70428)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:03.152776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:03.202217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1809dea675e14780b5a5698417c70428'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.209676 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1809dea675e14780b5a5698417c70428'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.210317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1809dea675e14780b5a5698417c70428'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.210914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1809dea675e14780b5a5698417c70428'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.222646 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1809dea675e14780b5a5698417c70428'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.235053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1390/2758] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:48:03 2022] DELETE /identity/v3/users/1809dea675e14780b5a5698417c70428 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:48:03.239932 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:03.240212 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:03.240483 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:03.258636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:03.259825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:03.319118 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1369/2759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:03.328896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:03.330505 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:03.389440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e44b9-1d4b-4b94-8abb-b70eb3fec955 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:03.393059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:03.393655 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:03.393975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:03.394246 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:03.403632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:03.405038 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53db19-555c-49dd-91f9-c23978b89367 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:03.415368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1391/2760] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:03.685032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:03.686508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:03.705088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a07c89-dbbe-406d-8aab-0bbb14a648fc None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:03.710626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:03.711259 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:03.711533 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:03.711801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] PATH_INFO: `/v3/projects/5b62742e4bbe499c9b917507fd60ab3f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:03.712912 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b62742e4bbe499c9b917507fd60ab3f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:03.714842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:03.762062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b62742e4bbe499c9b917507fd60ab3f', 'request_id': 'req-e68eba6d-8c83-41b4-8998-1b4c3a95263a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.769398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b62742e4bbe499c9b917507fd60ab3f', 'request_id': 'req-e68eba6d-8c83-41b4-8998-1b4c3a95263a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.776273 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b62742e4bbe499c9b917507fd60ab3f', 'request_id': 'req-e68eba6d-8c83-41b4-8998-1b4c3a95263a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.786432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] The token cache is being invalidate because project 5b62742e4bbe499c9b917507fd60ab3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:48:03.786740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.787351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:48:03.788869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1370/2761] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:48:03 2022] DELETE /identity/v3/projects/5b62742e4bbe499c9b917507fd60ab3f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:48:11.527059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755d341-10d5-4b9b-a151-b1f8b60a94f3 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:11.527568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755d341-10d5-4b9b-a151-b1f8b60a94f3 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:11.527670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755d341-10d5-4b9b-a151-b1f8b60a94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:11.547590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0755d341-10d5-4b9b-a151-b1f8b60a94f3 None None] MFA Rules not processed for user `2500a078012644c2862d9c17f914adf7`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:11.548786 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0755d341-10d5-4b9b-a151-b1f8b60a94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:11.565193 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:11.604359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1392/2762] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:48:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:13.783478 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:14.744425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:14.745877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:14.825338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eba6d-8c83-41b4-8998-1b4c3a95263a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:14.830849 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:14.831447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:14.831721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:14.831989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:14.833682 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:14.845946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:14.847507 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:14.858349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1371/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:20.384440 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98622e3-c36f-4871-8d2f-8fdb138f1d30 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:20.385047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98622e3-c36f-4871-8d2f-8fdb138f1d30 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:20.385047 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98622e3-c36f-4871-8d2f-8fdb138f1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:20.407849 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b98622e3-c36f-4871-8d2f-8fdb138f1d30 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:20.409941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b98622e3-c36f-4871-8d2f-8fdb138f1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:20.471872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1393/2764] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:48:20.508268 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:20.519735 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97360d-79e9-4386-b5bd-d27ac8852a1b service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:20.525397 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:20.526160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:20.526306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:20.526567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:20.535388 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:20.536956 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:20.546690 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1372/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:24.487235 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:24.487813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:24.487813 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:24.513575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:24.514822 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:24.523489 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1394/2766] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:24.545534 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:24.546948 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:24.561828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741f8fd-3929-4722-ac04-e63e7070663c service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:24.567156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:24.567761 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:24.568035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:24.568302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:24.576121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:24.577759 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd67c8-034d-4957-b120-310170931d82 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:24.587551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1373/2767] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:26.321700 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:26.333980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56665259-39a6-4d32-81cd-5e593d14e88d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:26.340043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:26.340634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:26.340912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:26.341182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:26.342932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:26.355004 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:26.356565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:26.367589 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1395/2768] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:28.756024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ba4e-f425-4e9f-8863-f1d28fc8caaf None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:28.756546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ba4e-f425-4e9f-8863-f1d28fc8caaf None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:28.756546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7ba4e-f425-4e9f-8863-f1d28fc8caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:28.776304 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-21a7ba4e-f425-4e9f-8863-f1d28fc8caaf None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:28.777508 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-21a7ba4e-f425-4e9f-8863-f1d28fc8caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:28.785898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1374/2769] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:28.807120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:28.818311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dbd29-fcf0-4e4c-bffd-7c1b68cb9956 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:28.824292 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:28.824876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:28.825152 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:28.825422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:28.833452 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:28.835036 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:28.844220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1396/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:31.852355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f32b6-e918-4106-97a1-dd0e66b63147 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:31.852888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f32b6-e918-4106-97a1-dd0e66b63147 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:31.852888 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f32b6-e918-4106-97a1-dd0e66b63147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:31.872898 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-699f32b6-e918-4106-97a1-dd0e66b63147 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:31.874194 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-699f32b6-e918-4106-97a1-dd0e66b63147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:31.883461 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1375/2771] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:31.907504 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:31.919710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b2331-81b9-40d6-bce8-c976c4bb6a3f service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:31.925398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:31.926009 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:31.926290 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:31.926565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:31.935280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:31.936898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:31.947184 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1397/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:36.046539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806b7b-fabb-4800-8aed-cecf44e18a9d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:36.047010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806b7b-fabb-4800-8aed-cecf44e18a9d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:36.047130 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26806b7b-fabb-4800-8aed-cecf44e18a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:36.066096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-26806b7b-fabb-4800-8aed-cecf44e18a9d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:36.067283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-26806b7b-fabb-4800-8aed-cecf44e18a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:36.075408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1376/2773] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:36.098875 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:36.109882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2cb69-dec6-4a80-8bae-8ae1a5cc43ae service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:36.115284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:36.116356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:36.116632 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:36.116902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:36.124764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:36.126359 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:36.136131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1398/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:39.213208 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0255-627d-43c6-af91-d804750965d7 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:39.213821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0255-627d-43c6-af91-d804750965d7 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:39.214236 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f0255-627d-43c6-af91-d804750965d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:39.244523 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-6f4f0255-627d-43c6-af91-d804750965d7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:39.245720 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-6f4f0255-627d-43c6-af91-d804750965d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:39.253588 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1377/2775] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:39.277330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:39.288463 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708be13-5971-44eb-9846-937f3a779e20 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:39.294298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:39.294893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:39.295195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:39.295468 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:39.303985 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:39.305537 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:39.314800 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1399/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:49.238716 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=58 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:49.310807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=75 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:48:54.272810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:54.273313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:54.273989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:54.293341 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] MFA Rules not processed for user `350000b9b7bd43199cfd94a9611f33e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:48:54.294579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:54.349718 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1378/2777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:48:54.583443 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:54.584926 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:54.664109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44673e32-edfb-4f45-bf32-e4608b989d84 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:54.667924 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:54.668510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:54.668784 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:54.669051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:54.670760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:54.679883 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:54.681358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:54.689370 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1400/2778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:48:55.027944 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:48:55.029447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:55.100692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3aaa0-b3eb-47e2-aafe-3d739f99d51f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:48:55.105540 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:48:55.106163 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:48:55.106437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:48:55.106700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:48:55.108363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:48:55.119740 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:48:55.121296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68c2e-3f5c-4832-8c03-dcd0956496c0 service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:48:55.130835 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1379/2779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:48:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:04.579388 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:04.593473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20be2c9-3312-4512-9f3b-d8720b09d74f service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:04.598951 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:04.599546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:04.599831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:04.600103 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:04.601878 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:04.613965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:04.615535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:04.626752 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1401/2780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:05.126753 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=57 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:49:09.541008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b543-75eb-4f96-b9cb-88472806f812 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:09.541982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b543-75eb-4f96-b9cb-88472806f812 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:09.541982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202b543-75eb-4f96-b9cb-88472806f812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:09.561252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5202b543-75eb-4f96-b9cb-88472806f812 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:49:09.562503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5202b543-75eb-4f96-b9cb-88472806f812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:09.570269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1380/2781] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:49:09.591449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:09.603472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6664d-d68d-456d-8a7c-02c007ffc2b9 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:09.608820 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:09.609403 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:09.609681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:09.609981 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:09.617869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:09.620106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:09.629363 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1402/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:12.803067 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3509-6b1b-47ea-9a93-bb1366be36b0 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:12.803595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3509-6b1b-47ea-9a93-bb1366be36b0 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:12.803595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3509-6b1b-47ea-9a93-bb1366be36b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:12.822275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-cf1a3509-6b1b-47ea-9a93-bb1366be36b0 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:49:12.823518 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-cf1a3509-6b1b-47ea-9a93-bb1366be36b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:12.831145 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1381/2783] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:49:12.851802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:12.863321 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11402393-c548-42cc-b0b5-3f05da868a5f service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:12.868984 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:12.869578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:12.869898 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:12.870178 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:12.878217 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:12.879782 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:12.889007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1403/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:15.881463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e23a5-ccf1-46b0-b99c-3a0f2b00392c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:15.881967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e23a5-ccf1-46b0-b99c-3a0f2b00392c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:15.881967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e23a5-ccf1-46b0-b99c-3a0f2b00392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:15.901347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d50e23a5-ccf1-46b0-b99c-3a0f2b00392c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:49:15.902532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d50e23a5-ccf1-46b0-b99c-3a0f2b00392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:15.910203 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1382/2785] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:49:15.931308 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:15.942120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddeb31-5d21-480d-a8e1-5852b23aeee0 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:15.948051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:15.948628 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:15.948935 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:15.949198 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:15.957002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:15.958580 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:15.967653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1404/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:19.041803 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f71c2-832c-4d21-aa47-5657e0b71e07 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:19.042306 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f71c2-832c-4d21-aa47-5657e0b71e07 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:19.042427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f71c2-832c-4d21-aa47-5657e0b71e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:19.061669 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0e6f71c2-832c-4d21-aa47-5657e0b71e07 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:49:19.062864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0e6f71c2-832c-4d21-aa47-5657e0b71e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:19.070432 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1383/2787] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:49:19.092776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:19.103802 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3eaf-c4d7-4eea-ad9b-edc0c037f0d0 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:19.109721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:19.110356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:19.110636 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:19.110905 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:19.118790 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:19.120988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:19.130213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1405/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:23.221623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:23.222169 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:23.222274 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:23.241874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:49:23.243048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:23.250614 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1384/2789] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Sep 12 15:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:49:23.273101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:23.279400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=57 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:49:23.285324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f125f-c1ec-415d-a4a9-2f6ac7508d50 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:23.290906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:23.291756 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:23.292033 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:23.292303 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:23.300864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:23.302461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:23.311585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1406/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:33.236441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=15 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:49:33.307457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:49:41.255903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:41.268200 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec141b07-281b-4938-a4dc-785e73a08d1b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:41.273554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ce045e8077e433ba889e189fb1c690b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:41.274220 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:41.274495 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:41.274762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:41.276439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:41.286916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:41.288468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:41.298022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1385/2791] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:49:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:49:51.294039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=6 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:49:54.268252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:54.269716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:49:54.282932 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8382b-522a-444e-b292-eda44b816f84 service nova] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:54.287487 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:54.288113 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:54.288430 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:54.288581 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] PATH_INFO: `/v3/users/350000b9b7bd43199cfd94a9611f33e3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:54.289896 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350000b9b7bd43199cfd94a9611f33e3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:54.292053 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:54.344330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350000b9b7bd43199cfd94a9611f33e3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.351689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350000b9b7bd43199cfd94a9611f33e3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.352406 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350000b9b7bd43199cfd94a9611f33e3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.352986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350000b9b7bd43199cfd94a9611f33e3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.364619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350000b9b7bd43199cfd94a9611f33e3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.376402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1407/2792] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:49:54 2022] DELETE /identity/v3/users/350000b9b7bd43199cfd94a9611f33e3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:49:54.550965 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:49:54.562907 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f12dd-63c3-47b2-a35f-7e863c465024 service nova] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:49:54.620941 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:49:54.621554 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:49:54.621863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:49:54.622132 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] PATH_INFO: `/v3/projects/949c78cebb8c48c1b47ce8e1c2593ffb` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:49:54.623251 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949c78cebb8c48c1b47ce8e1c2593ffb)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:49:54.625114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:49:54.670458 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949c78cebb8c48c1b47ce8e1c2593ffb', 'request_id': 'req-b15d57bd-1b94-43b9-83b0-136c5bc71657'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.677750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949c78cebb8c48c1b47ce8e1c2593ffb', 'request_id': 'req-b15d57bd-1b94-43b9-83b0-136c5bc71657'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.684579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949c78cebb8c48c1b47ce8e1c2593ffb', 'request_id': 'req-b15d57bd-1b94-43b9-83b0-136c5bc71657'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.695082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] The token cache is being invalidate because project 949c78cebb8c48c1b47ce8e1c2593ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:49:54.695371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.696024 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:49:54.708917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1386/2793] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:49:54 2022] DELETE /identity/v3/projects/949c78cebb8c48c1b47ce8e1c2593ffb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:02.384571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:02.385992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:02.441591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55bd8-5e2d-4c7d-804c-3facd4e24ca0 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:02.488746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:02.489342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:02.489616 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:02.489915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:02.491681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:02.532207 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:02.554427 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:02.555785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:02.565404 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1408/2794] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:04.692052 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:05.542656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:05.544054 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:05.613909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:05.615375 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:05.621039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d57bd-1b94-43b9-83b0-136c5bc71657 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:05.628042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:05.628585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98338-9dca-48d5-b5df-d0e6c5e9cde3 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:05.628707 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:05.628908 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:05.629250 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:05.631034 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:05.633716 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:05.634392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:05.634668 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:05.634940 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] PATH_INFO: `/v3/users/2500a078012644c2862d9c17f914adf7` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:05.636098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2500a078012644c2862d9c17f914adf7)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:05.638025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:05.643178 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:05.644741 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:05.654634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1387/2795] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:50:05.689071 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2500a078012644c2862d9c17f914adf7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:05.696844 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2500a078012644c2862d9c17f914adf7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:05.697553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2500a078012644c2862d9c17f914adf7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:05.698288 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2500a078012644c2862d9c17f914adf7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:05.710501 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-32578197-2fbd-43b0-bff0-9ee7b7c7c250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2500a078012644c2862d9c17f914adf7'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:05.722603 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1409/2796] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:05 2022] DELETE /identity/v3/users/2500a078012644c2862d9c17f914adf7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 15:50:05.897278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:05.909165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00eb7-4e05-4c36-94ed-b70994418d94 service placement] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:05.964433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:05.965045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:05.965320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:05.965595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] PATH_INFO: `/v3/projects/c733794058074008a6092098fc57c94e` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:05.966731 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c733794058074008a6092098fc57c94e)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:05.968609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.012844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c733794058074008a6092098fc57c94e', 'request_id': 'req-f2ba1c79-6398-4431-8c03-64da61d13ab1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:06.019992 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c733794058074008a6092098fc57c94e', 'request_id': 'req-f2ba1c79-6398-4431-8c03-64da61d13ab1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:06.026587 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c733794058074008a6092098fc57c94e', 'request_id': 'req-f2ba1c79-6398-4431-8c03-64da61d13ab1'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:06.036581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] The token cache is being invalidate because project c733794058074008a6092098fc57c94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:06.036870 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:06.037503 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-f2ba1c79-6398-4431-8c03-64da61d13ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:06.038959 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1388/2797] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:05 2022] DELETE /identity/v3/projects/c733794058074008a6092098fc57c94e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:06.044741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.045024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.045294 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.064669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:06.065899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:06.124329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1410/2798] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:06.132319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.132603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.132877 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.152681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:06.153914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:06.161549 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1389/2799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:06.165509 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.175775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff5b8-2c80-47d2-ba46-5811840c1380 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.180330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.180912 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.181188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.181456 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.182135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:06.182435 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.184010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.195191 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1411/2800] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:06.199439 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.208246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2f5c-7842-4817-b734-1ca3fbb2b015 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.212686 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.213466 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.214260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.214528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.215141 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.217013 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.227680 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:06.245561 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1390/2801] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:06.249644 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.259392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f03e95-dc77-4283-8524-72ebb40ecc69 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.292507 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:06.315722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.316307 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.316585 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.316853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.317474 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.319410 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.340721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1412/2802] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:50:06.344930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.354834 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3caa6-f557-4da2-8503-f9cf7cae9113 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.359371 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.359973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.360246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.360532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.361135 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.362726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.372622 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1391/2803] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:50:06.376670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.387170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2569-5924-47fb-ba80-84f4a59b4b64 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.391964 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.392555 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.392829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.393093 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.393720 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.395300 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a6dee-0148-4fff-926a-ef8cf509bea3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.405548 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1413/2804] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:06.409573 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.419774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43cc8d-b50d-495d-9e8e-330f1915f275 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.424387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.425110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.425410 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.425681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] PATH_INFO: `/v3/projects/25100c52047445d5ab761b2dccec51d0/users/6c7c8169176b48b79b2af1c643c92e7b/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.439981 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=25100c52047445d5ab761b2dccec51d0, user_id=6c7c8169176b48b79b2af1c643c92e7b, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.442724 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.455551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1392/2805] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:06 2022] PUT /identity/v3/projects/25100c52047445d5ab761b2dccec51d0/users/6c7c8169176b48b79b2af1c643c92e7b/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:06.467462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.467777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.468048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.495283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] MFA Rules not processed for user `6c7c8169176b48b79b2af1c643c92e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:06.496518 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:06.559869 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1414/2806] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:50:06.564468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.624916 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed487f0b-c8fc-4fe0-b5e5-bb2fe96c29ff admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.629521 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.630147 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.630427 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.630699 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.631330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.633253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.659443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1393/2807] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:06.663595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.674486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a80f0-9f41-4466-a946-6dfd694ba0ab None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.730712 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.731309 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.731596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.731865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.732496 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.734449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.756104 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1415/2808] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:06.760078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.770878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7e2f5-4fc8-44c4-a46d-83731cce8429 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.775492 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.776087 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.776367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.776643 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.777276 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.778924 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.789606 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1394/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:06.793882 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.803807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f1e4-f96e-412f-8159-4d546d07ca38 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.808847 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.809488 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.809795 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.810119 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] PATH_INFO: `/v3/projects/22fdc21670644456b6939d95e9f284d3/users/7f3b4d3d0278457081d23359202fce37/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.824785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fdc21670644456b6939d95e9f284d3, user_id=7f3b4d3d0278457081d23359202fce37, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.827457 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.839862 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1416/2810] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:06 2022] PUT /identity/v3/projects/22fdc21670644456b6939d95e9f284d3/users/7f3b4d3d0278457081d23359202fce37/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:06.843799 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.853438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbe6cd-550e-4f95-a6bb-772c4c991c7d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.911726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.912412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.912593 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.912864 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.913501 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.915153 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf2b68-4db4-4bb9-9245-c62133463b04 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.929787 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1395/2811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:06.930793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:06.941590 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfef5a-1853-472b-b64c-abf5117a2293 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:06.947702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:06.947861 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.948686 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.948987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] PATH_INFO: `/v3/projects/22fdc21670644456b6939d95e9f284d3/users/7f3b4d3d0278457081d23359202fce37/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:06.950930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fdc21670644456b6939d95e9f284d3, user_id=7f3b4d3d0278457081d23359202fce37, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:06.953461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:06.959423 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:06.965434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1417/2812] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:06 2022] PUT /identity/v3/projects/22fdc21670644456b6939d95e9f284d3/users/7f3b4d3d0278457081d23359202fce37/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:06.975733 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:06.976016 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:06.976288 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:07.003861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] MFA Rules not processed for user `7f3b4d3d0278457081d23359202fce37`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:07.005045 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:07.017814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:07.072258 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1396/2813] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:07.083833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:07.085546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:07.142298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae431d0-60f2-4e68-9bce-10d77df191fd admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:07.145876 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:07.146460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:07.146735 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:07.147002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:07.155510 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:07.156910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2602ea-c418-4dec-9cff-96a6d9275e5e service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:07.166340 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1418/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:07.570152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:07.629701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500a50e-0137-475d-89bc-f6d9831f2063 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:07.634040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:07.634649 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:07.634923 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:07.635192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] PATH_INFO: `/v3/users/6c7c8169176b48b79b2af1c643c92e7b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:07.636324 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7c8169176b48b79b2af1c643c92e7b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:07.638247 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:07.684979 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7c8169176b48b79b2af1c643c92e7b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:07.692224 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7c8169176b48b79b2af1c643c92e7b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:07.704161 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7c8169176b48b79b2af1c643c92e7b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:07.704841 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7c8169176b48b79b2af1c643c92e7b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:07.705438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7c8169176b48b79b2af1c643c92e7b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:07.718563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1397/2815] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:07 2022] DELETE /identity/v3/users/6c7c8169176b48b79b2af1c643c92e7b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:07.722968 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:07.723465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:07.723568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:07.742284 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:07.743462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:07.800278 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1419/2816] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:50:07.809989 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:07.811409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:07.845431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:07.869182 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e54f5-f89e-4b70-8395-781283a9d2f7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:07.872873 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:07.873825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:07.873825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:07.874990 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:07.887278 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:07.888672 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:07.898205 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1398/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:08.159571 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:08.161018 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:08.172858 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b934-0cbb-4e83-88c5-2568587181b6 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:08.179831 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:08.180471 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.180753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.181014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] PATH_INFO: `/v3/projects/25100c52047445d5ab761b2dccec51d0` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.182171 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25100c52047445d5ab761b2dccec51d0)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:08.184569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:08.230041 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25100c52047445d5ab761b2dccec51d0', 'request_id': 'req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.236029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25100c52047445d5ab761b2dccec51d0', 'request_id': 'req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.243329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25100c52047445d5ab761b2dccec51d0', 'request_id': 'req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.254000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] The token cache is being invalidate because project 25100c52047445d5ab761b2dccec51d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:08.254285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.254906 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.256343 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1420/2818] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:08 2022] DELETE /identity/v3/projects/25100c52047445d5ab761b2dccec51d0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:08.260356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:08.270535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42890-efe5-4e7f-af02-ef28ffd335c2 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:08.325300 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:08.325957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.326239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.326510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] PATH_INFO: `/v3/users/7f3b4d3d0278457081d23359202fce37` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.327632 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3b4d3d0278457081d23359202fce37)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:08.329560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:08.375811 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3b4d3d0278457081d23359202fce37'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.382831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3b4d3d0278457081d23359202fce37'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.395583 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3b4d3d0278457081d23359202fce37'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.396245 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3b4d3d0278457081d23359202fce37'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.396843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-1df4dce0-6424-493c-965f-137618133031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3b4d3d0278457081d23359202fce37'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.409443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1399/2819] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:08 2022] DELETE /identity/v3/users/7f3b4d3d0278457081d23359202fce37 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:08.678048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:08.679597 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:08.693508 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf833c-9751-45fa-95b2-46d4ec93f3f1 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:08.716313 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:08.754969 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:08.755605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.755843 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.756110 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] PATH_INFO: `/v3/projects/22fdc21670644456b6939d95e9f284d3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.757195 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fdc21670644456b6939d95e9f284d3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:08.759098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:08.803412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fdc21670644456b6939d95e9f284d3', 'request_id': 'req-4ecc173c-ffd6-4037-a330-e289fbfd4f53'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.810020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fdc21670644456b6939d95e9f284d3', 'request_id': 'req-4ecc173c-ffd6-4037-a330-e289fbfd4f53'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.817335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fdc21670644456b6939d95e9f284d3', 'request_id': 'req-4ecc173c-ffd6-4037-a330-e289fbfd4f53'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.827360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] The token cache is being invalidate because project 22fdc21670644456b6939d95e9f284d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:08.827641 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.828251 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-4ecc173c-ffd6-4037-a330-e289fbfd4f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:08.829687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1421/2820] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:08 2022] DELETE /identity/v3/projects/22fdc21670644456b6939d95e9f284d3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:08.834651 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.834942 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.835329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.856265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:08.857447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:08.913842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:08.928094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1400/2821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:08.937140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.937426 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.937702 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.956992 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:08.958230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:08.966498 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1422/2822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:08.970654 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:08.981082 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f86f09-21cf-4c20-b594-c9848810b6fa None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:08.985747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:08.986346 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:08.986624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:08.986894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:08.987560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:08.987858 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:08.989433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.000842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1401/2823] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:09.005129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.014114 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d47e8-4002-49e7-946c-7ccb934a4c0e None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.018930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.019521 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.019801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.020073 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.020713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.022682 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.050100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1423/2824] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:09.054119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.063765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7eb96-d847-4c3e-bf4a-627e56ea7fc3 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.118384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.118977 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.119254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.119524 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.120189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.122137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.142514 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1402/2825] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:09.146706 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.157183 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3e3f-7244-4ba2-a503-4c127635208d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.161799 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.162596 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.162874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.163137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.163789 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.165362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.175824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1424/2826] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:09.179479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.189184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712cbfe-3848-4318-a413-68328b1aecb9 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.193697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.194302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.194581 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.194853 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.195481 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.197056 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb3ec-65a5-4f05-8be2-ad8e1a8fd06e admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.208289 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1403/2827] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:09.212250 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.222465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac944aa-e7eb-4e1b-94b0-7a484b7dbb2d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.226977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.227612 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.227886 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.228155 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] PATH_INFO: `/v3/projects/c42b3b59e43d4cfba9602e59da111619/users/92bee2848c0b42189ebc981b3943397c/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.243362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42b3b59e43d4cfba9602e59da111619, user_id=92bee2848c0b42189ebc981b3943397c, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.246062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.259221 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1425/2828] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:09 2022] PUT /identity/v3/projects/c42b3b59e43d4cfba9602e59da111619/users/92bee2848c0b42189ebc981b3943397c/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:09.269560 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.270084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.270183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.298269 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] MFA Rules not processed for user `92bee2848c0b42189ebc981b3943397c`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:09.299445 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:09.361102 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1404/2829] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:09.365626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.415422 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:09.428067 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf27f-32cf-4bc6-850b-8ed551f52f44 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.432714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.433245 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.433524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.433829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.434449 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.436330 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.461948 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1426/2830] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:09.466641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.477165 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003696-5b45-449e-b74b-fbaceef9c08b None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.520401 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:09.533910 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.534506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.534781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.535048 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.535695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.537579 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.558166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1405/2831] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:09.562109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.572008 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b7ba2-bd5a-4d56-930f-958d7fc0316c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.576977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.577560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.577871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.578139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.578765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.580327 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.591189 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1427/2832] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:50:09.595160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.605015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528128dd-6fac-4519-9832-59f94daa30bd admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.609591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.610254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.610529 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.610798 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] PATH_INFO: `/v3/projects/ecb61a4684c246689262f32aa63e3036/users/78c650cbebc84532bf806b47e1216774/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.625007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb61a4684c246689262f32aa63e3036, user_id=78c650cbebc84532bf806b47e1216774, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.627645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.641683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1406/2833] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:09 2022] PUT /identity/v3/projects/ecb61a4684c246689262f32aa63e3036/users/78c650cbebc84532bf806b47e1216774/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:09.646077 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.656415 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6306a26-7c8f-4cc0-8a31-5df7a4f6982b admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.712000 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.712619 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.712893 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.713160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.713824 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.715395 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4667f5b-5645-4907-bb78-a7c5d3f2e6e5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.724963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1428/2834] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:09.729282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.739435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d178755-06c7-4b56-b31d-0569f9920133 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.744119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.745254 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.745527 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.745824 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] PATH_INFO: `/v3/projects/ecb61a4684c246689262f32aa63e3036/users/78c650cbebc84532bf806b47e1216774/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.747692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb61a4684c246689262f32aa63e3036, user_id=78c650cbebc84532bf806b47e1216774, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.750400 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.760255 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1407/2835] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:09 2022] PUT /identity/v3/projects/ecb61a4684c246689262f32aa63e3036/users/78c650cbebc84532bf806b47e1216774/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:09.770884 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.771376 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.771483 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.798941 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] MFA Rules not processed for user `78c650cbebc84532bf806b47e1216774`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:09.800141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:09.866227 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1429/2836] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:09.877681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:09.879379 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:09.939047 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fe2ed-0e05-4bac-ba51-d9bc36d9cc34 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:09.942553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:09.943142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:09.943417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:09.943687 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:09.952355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:09.953794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:09.962982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1408/2837] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:10.036617 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:10.046910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42daedce-e596-45ab-a2d1-9025a37785f4 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:10.050547 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:10.051135 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:10.051412 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:10.051684 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:10.097863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:10.114661 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:10.116355 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e85ff-8655-409e-8011-86d676cdd140 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:10.127469 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1430/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:17.095003 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:17.156038 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae6b5-5d5f-41c4-b41a-8631ed33c6c5 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:17.160515 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:17.161126 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:17.161403 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:17.161673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] PATH_INFO: `/v3/users/92bee2848c0b42189ebc981b3943397c` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:17.162806 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bee2848c0b42189ebc981b3943397c)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:17.164700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:17.208785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:17.210338 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bee2848c0b42189ebc981b3943397c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.219008 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bee2848c0b42189ebc981b3943397c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.230697 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bee2848c0b42189ebc981b3943397c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.231374 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bee2848c0b42189ebc981b3943397c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.231975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bee2848c0b42189ebc981b3943397c'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.244892 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1409/2839] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:17 2022] DELETE /identity/v3/users/92bee2848c0b42189ebc981b3943397c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:17.249323 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:17.249873 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:17.249976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:17.269286 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:17.270670 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:17.330020 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1431/2840] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:17.339705 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:17.341089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:17.397233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc55cc-df12-4100-a42b-282f4fb836e1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:17.400829 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:17.401416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:17.401691 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:17.401987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:17.410711 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:17.412125 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:17.421552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1410/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:17.688255 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:17.689680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:17.703013 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093d264-0c70-4dc8-872a-9f55fb1a5458 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:17.707826 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:17.708451 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:17.708728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:17.708999 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] PATH_INFO: `/v3/projects/c42b3b59e43d4cfba9602e59da111619` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:17.710148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42b3b59e43d4cfba9602e59da111619)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:17.712087 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:17.758081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42b3b59e43d4cfba9602e59da111619', 'request_id': 'req-86c3db21-97df-4e9f-826c-afcb379b40cb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.764280 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42b3b59e43d4cfba9602e59da111619', 'request_id': 'req-86c3db21-97df-4e9f-826c-afcb379b40cb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.771669 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42b3b59e43d4cfba9602e59da111619', 'request_id': 'req-86c3db21-97df-4e9f-826c-afcb379b40cb'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.781648 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] The token cache is being invalidate because project c42b3b59e43d4cfba9602e59da111619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:17.781957 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.782577 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.784029 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1432/2842] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:17 2022] DELETE /identity/v3/projects/c42b3b59e43d4cfba9602e59da111619 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:17.788171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:17.798425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbbda4-f917-4724-8040-705be0458fb7 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:17.853344 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:17.854479 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:17.854758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:17.855029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] PATH_INFO: `/v3/users/78c650cbebc84532bf806b47e1216774` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:17.856142 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c650cbebc84532bf806b47e1216774)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:17.858110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:17.911936 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c650cbebc84532bf806b47e1216774'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.920726 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c650cbebc84532bf806b47e1216774'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.929915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:17.934921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c650cbebc84532bf806b47e1216774'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.935704 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c650cbebc84532bf806b47e1216774'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.936509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-dd287407-5de3-464e-b9f5-682bacbf84f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c650cbebc84532bf806b47e1216774'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:17.949392 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1411/2843] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:17 2022] DELETE /identity/v3/users/78c650cbebc84532bf806b47e1216774 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:18.211267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.212954 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:18.229714 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3db21-97df-4e9f-826c-afcb379b40cb admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.285722 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.286405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.286631 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.286899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] PATH_INFO: `/v3/projects/ecb61a4684c246689262f32aa63e3036` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.287997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb61a4684c246689262f32aa63e3036)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.289921 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.300890 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:18.337746 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb61a4684c246689262f32aa63e3036', 'request_id': 'req-80394dc8-dcde-430f-9caf-36973e33ec7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:18.344402 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb61a4684c246689262f32aa63e3036', 'request_id': 'req-80394dc8-dcde-430f-9caf-36973e33ec7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:18.351392 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb61a4684c246689262f32aa63e3036', 'request_id': 'req-80394dc8-dcde-430f-9caf-36973e33ec7d'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:18.361602 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] The token cache is being invalidate because project ecb61a4684c246689262f32aa63e3036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:18.361908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:18.362529 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-80394dc8-dcde-430f-9caf-36973e33ec7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:18.363978 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1433/2844] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:18 2022] DELETE /identity/v3/projects/ecb61a4684c246689262f32aa63e3036 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:18.368856 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.369320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.369417 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.389440 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:18.390706 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:18.448615 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1412/2845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:18.456311 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.456598 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.456871 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.476729 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:18.477953 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:18.485697 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1434/2846] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:18.489919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.499437 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a942-fef2-44ce-adc7-cabeaa02902f None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.504007 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.504589 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.504868 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.505144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.505815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:18.506121 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.507700 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.519441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1413/2847] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:18.523515 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.534358 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac4737-8289-4c3c-8e55-7973d1a9315f None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.538908 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.539485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.539760 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.540026 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.540647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.542834 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.570056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1435/2848] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:18.574404 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.584176 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cc8d7-a430-46b9-a42c-f226bb6f710a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.639698 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.640287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.640591 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.640863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.641476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.643416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.664462 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1414/2849] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:18.668930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.679194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdade18-87e1-4296-9ffa-823f9974ab8d admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.684360 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.684987 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.685264 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.685535 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.686210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.687788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.698453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1436/2850] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:18.702305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.712396 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6cfcd-5456-48ca-816d-69084247cb4d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.716963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.717552 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.717867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.718137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.718765 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.720340 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41055588-dfbc-426e-9124-7f9736539d18 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.730626 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1415/2851] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:18.734465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.744192 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee8eb0-3e9f-4142-9ecf-8b48be8458d7 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.749186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.749855 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.750131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.750399 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] PATH_INFO: `/v3/projects/ab38d5ea1e3d4e77ba8fc8de7774a44e/users/1d3f8edf4d1f4f1a81b6eaa25eb5ba61/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.765006 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab38d5ea1e3d4e77ba8fc8de7774a44e, user_id=1d3f8edf4d1f4f1a81b6eaa25eb5ba61, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.767645 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.780126 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1437/2852] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:18 2022] PUT /identity/v3/projects/ab38d5ea1e3d4e77ba8fc8de7774a44e/users/1d3f8edf4d1f4f1a81b6eaa25eb5ba61/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:18.790292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.790571 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.790837 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.819095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] MFA Rules not processed for user `1d3f8edf4d1f4f1a81b6eaa25eb5ba61`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:18.820348 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:18.858566 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:18.884750 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1416/2853] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:18.889865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:18.951715 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d412a9-4e53-4438-a261-1593bf2a7479 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:18.956269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:18.956856 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:18.957132 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:18.957398 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:18.958051 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:18.959914 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:18.985282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1438/2854] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:18.989299 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.000116 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002d93-f4fd-4bd0-8870-c307e0b7ec6d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.054679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.055265 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.055539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.055808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.056433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.058934 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.079448 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1417/2855] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:18 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:19.083334 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.093517 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134acd9-414b-4f0d-916f-75fb3b55080c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.098118 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.098699 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.098973 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.099238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.099863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.101425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.112298 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1439/2856] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:19.116391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.126621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8895651-4398-4df4-af91-265ed47b5335 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.131088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.131709 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.131987 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.132256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] PATH_INFO: `/v3/projects/8ffa8f616a0f44b4813110d5057927e0/users/664ab8687ce545febc55012cd8d5ac44/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.146582 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffa8f616a0f44b4813110d5057927e0, user_id=664ab8687ce545febc55012cd8d5ac44, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.149195 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.161751 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1418/2857] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:19 2022] PUT /identity/v3/projects/8ffa8f616a0f44b4813110d5057927e0/users/664ab8687ce545febc55012cd8d5ac44/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:19.165629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.176096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad6499-f633-47cb-887c-e9e32b43fcbe admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.180568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:19.233473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.234100 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.234381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.234654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.235285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.236902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403b45f-8888-46d8-85f5-8639d1f6e16e admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.246919 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1440/2858] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:19.250985 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.260963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ba8a-45ee-4a6d-a14c-80f022ffaa70 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.265491 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.266159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.266435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.266701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] PATH_INFO: `/v3/projects/8ffa8f616a0f44b4813110d5057927e0/users/664ab8687ce545febc55012cd8d5ac44/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.268576 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffa8f616a0f44b4813110d5057927e0, user_id=664ab8687ce545febc55012cd8d5ac44, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.271228 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.281281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1419/2859] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:19 2022] PUT /identity/v3/projects/8ffa8f616a0f44b4813110d5057927e0/users/664ab8687ce545febc55012cd8d5ac44/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:19.345080 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.345654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.345654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.374031 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] MFA Rules not processed for user `664ab8687ce545febc55012cd8d5ac44`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:19.375236 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:19.440986 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1441/2860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:19.453386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:19.455158 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:19.512653 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb43db4-ceda-41fe-86d4-a96a507f1d4d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:19.516239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:19.516831 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:19.517105 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:19.517375 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:19.561617 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:19.573998 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:19.575435 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:19.584214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1420/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:22.133527 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:22.143137 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4764b-7757-4a9b-8c56-eb8c102def43 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:22.146605 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:22.147187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:22.147458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:22.147721 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:22.156196 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:22.157608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:22.167381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1442/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:26.907545 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:26.908919 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:26.977061 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac73f4-65ba-4d93-beb3-1cc8ae080770 service cinder] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:26.982692 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:26.983285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:26.983563 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:26.983833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:26.985528 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:26.996721 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:26.998331 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d27814-27b4-493f-b89d-1db6cfa92f0c service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:27.008463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1421/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:32.162560 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=65 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:34.816654 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:34.880937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd208c-55fa-43ed-9c0a-1df61280d2d9 service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:34.885573 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:34.886222 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:34.886503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:34.886776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] PATH_INFO: `/v3/users/1d3f8edf4d1f4f1a81b6eaa25eb5ba61` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:34.888389 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3f8edf4d1f4f1a81b6eaa25eb5ba61)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:34.890356 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:34.939040 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3f8edf4d1f4f1a81b6eaa25eb5ba61'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:34.946199 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3f8edf4d1f4f1a81b6eaa25eb5ba61'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:34.946827 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3f8edf4d1f4f1a81b6eaa25eb5ba61'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:34.947431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3f8edf4d1f4f1a81b6eaa25eb5ba61'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:34.960007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3f8edf4d1f4f1a81b6eaa25eb5ba61'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:34.972638 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1443/2864] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:34 2022] DELETE /identity/v3/users/1d3f8edf4d1f4f1a81b6eaa25eb5ba61 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:34.977216 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:34.977713 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:34.977844 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:34.996261 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:34.997447 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:35.055029 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1422/2865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:50:35.064653 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:35.066091 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:35.122695 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b478c-ebe2-42dc-96c6-c448823f7d70 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:35.126400 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:35.126997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:35.127269 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:35.127534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:35.136965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:35.139057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:35.148142 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1444/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:35.430701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:35.432209 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:35.444416 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fadd9-a5f2-44b2-aa65-c5f28dd4454d None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:35.448947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:35.450252 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:35.450512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:35.450778 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] PATH_INFO: `/v3/projects/ab38d5ea1e3d4e77ba8fc8de7774a44e` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:35.452747 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab38d5ea1e3d4e77ba8fc8de7774a44e)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:35.454973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:35.503745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab38d5ea1e3d4e77ba8fc8de7774a44e', 'request_id': 'req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.511215 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab38d5ea1e3d4e77ba8fc8de7774a44e', 'request_id': 'req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.518473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab38d5ea1e3d4e77ba8fc8de7774a44e', 'request_id': 'req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.525450 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:35.529833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] The token cache is being invalidate because project ab38d5ea1e3d4e77ba8fc8de7774a44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:35.530363 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.531469 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.533222 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1423/2867] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:35 2022] DELETE /identity/v3/projects/ab38d5ea1e3d4e77ba8fc8de7774a44e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:35.537283 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:35.547911 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30275140-5a06-497d-a6be-752291e12463 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:35.566988 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:35.613865 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:35.614492 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:35.614772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:35.615044 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] PATH_INFO: `/v3/users/664ab8687ce545febc55012cd8d5ac44` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:35.616158 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664ab8687ce545febc55012cd8d5ac44)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:35.618146 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:35.663578 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664ab8687ce545febc55012cd8d5ac44'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.672481 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664ab8687ce545febc55012cd8d5ac44'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.673130 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664ab8687ce545febc55012cd8d5ac44'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.673809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664ab8687ce545febc55012cd8d5ac44'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.690099 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-1208bcf5-a285-44c1-8b3c-27dd233ee542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664ab8687ce545febc55012cd8d5ac44'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:35.704671 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1445/2868] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:35 2022] DELETE /identity/v3/users/664ab8687ce545febc55012cd8d5ac44 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:35.967736 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:35.970774 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:35.987172 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100fe1f-1b1d-4b39-a60b-f8a4ec2948af admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.047553 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.048091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.048391 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.048661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] PATH_INFO: `/v3/projects/8ffa8f616a0f44b4813110d5057927e0` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.049790 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffa8f616a0f44b4813110d5057927e0)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.051808 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.097673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffa8f616a0f44b4813110d5057927e0', 'request_id': 'req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:36.106330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffa8f616a0f44b4813110d5057927e0', 'request_id': 'req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:36.112395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffa8f616a0f44b4813110d5057927e0', 'request_id': 'req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:36.123963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] The token cache is being invalidate because project 8ffa8f616a0f44b4813110d5057927e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:36.124296 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:36.124945 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-23ab0802-a044-4fd0-ba1f-98d77e1ddf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:36.126488 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1424/2869] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:35 2022] DELETE /identity/v3/projects/8ffa8f616a0f44b4813110d5057927e0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:36.131428 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.131894 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.132074 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.151976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:36.153215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:36.213159 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1446/2870] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:36.220822 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.221110 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.221387 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.241310 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:36.242548 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:36.250950 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1425/2871] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:36.255172 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.264742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff28db-0178-4a89-b324-4e32e2b9dec8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.269252 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.269870 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.270148 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.270418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.271056 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:36.271357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.272928 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.284144 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1447/2872] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:36.288433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.298256 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9464e-c71d-4aac-9b2a-7cf6258b095c None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.302685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.303260 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.303535 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.303801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.304425 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.306337 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.333226 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1426/2873] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:36.337455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.347372 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44c36-5960-4ce0-8216-e0447ece27f5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.373797 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:36.404553 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.405145 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.405420 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.405687 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.406331 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.408215 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.434639 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1448/2874] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:36.439092 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.449330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488a7f1-630d-4e79-a2db-b0989f60faab admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.454095 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.454684 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.454964 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.455233 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.455869 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.457473 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.467275 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1427/2875] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:36.471293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.481634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76131e0-fb14-435c-bdd5-ecee790d2831 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.486219 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.486803 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.487081 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.487349 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.487977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.489561 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b4ec7-84f9-4fb6-95ca-ca61321c8dd4 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.500837 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1449/2876] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:36.504953 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.514843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f277f07-9c93-4da2-853d-fb1ca3e1252f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.519402 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.520040 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.520319 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.520595 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] PATH_INFO: `/v3/projects/d2b9e3f2d1054be8b89c58c4ab73eb5d/users/b962e015507641e88a555951d139a288/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.536894 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b9e3f2d1054be8b89c58c4ab73eb5d, user_id=b962e015507641e88a555951d139a288, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.539620 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.553244 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1428/2877] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:36 2022] PUT /identity/v3/projects/d2b9e3f2d1054be8b89c58c4ab73eb5d/users/b962e015507641e88a555951d139a288/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:36.563717 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.564002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.564273 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.592528 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] MFA Rules not processed for user `b962e015507641e88a555951d139a288`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:36.593751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:36.662793 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1450/2878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:36.667642 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.697867 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:36.732878 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378ea19-2803-4153-a5b5-c457e504ac5d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.737522 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.738133 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.738414 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.738685 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.739321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.741210 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.767441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1429/2879] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:36.771680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.782677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d38ce8-5ab6-4342-8b00-e582203a2144 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.837710 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.838302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.838584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.838881 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.839534 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.841958 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.863174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1451/2880] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:36 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:50:36.867311 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.877442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882482b-2dd9-437d-9890-caa91b0b1c9a admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.881994 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.882578 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.882887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.883112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.883746 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.885446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.897057 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1430/2881] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:36.901230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.911431 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bac04-c560-4d8d-bcf7-27d0ddf9d9fa admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:36.915925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:36.916819 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:36.917095 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:36.917364 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] PATH_INFO: `/v3/projects/28f99218ceb0446ab9c924c3db7e9a10/users/2d24275754ff4379a3f4eaf8d0317ec3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:36.933352 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f99218ceb0446ab9c924c3db7e9a10, user_id=2d24275754ff4379a3f4eaf8d0317ec3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:36.936320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:36.951595 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1452/2882] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:36 2022] PUT /identity/v3/projects/28f99218ceb0446ab9c924c3db7e9a10/users/2d24275754ff4379a3f4eaf8d0317ec3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:36.955621 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:36.965693 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af62a-9bc0-4a88-a25d-4034952aad97 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:37.020221 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:37.020967 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:37.021089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:37.021330 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:37.022022 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:37.023598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3598ee-8656-403a-9bd1-6492c98ff82f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:37.034661 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1431/2883] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:37.038990 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:37.044897 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:37.051276 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950ef7-b6b8-462d-bc84-40c320f5abe2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:37.056083 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:37.056728 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:37.057010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:37.057282 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] PATH_INFO: `/v3/projects/28f99218ceb0446ab9c924c3db7e9a10/users/2d24275754ff4379a3f4eaf8d0317ec3/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:37.059205 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f99218ceb0446ab9c924c3db7e9a10, user_id=2d24275754ff4379a3f4eaf8d0317ec3, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:37.061853 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:37.072120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1453/2884] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:37 2022] PUT /identity/v3/projects/28f99218ceb0446ab9c924c3db7e9a10/users/2d24275754ff4379a3f4eaf8d0317ec3/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:37.083982 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:37.084351 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:37.084623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:37.112286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] MFA Rules not processed for user `2d24275754ff4379a3f4eaf8d0317ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:37.113412 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:37.182356 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1432/2885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:37 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:37.193162 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:37.194910 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:37.251001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f8e2-b881-4d36-8fbd-8f33b38105aa admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:37.254599 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:37.255194 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:37.255472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:37.255741 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:37.265001 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:37.266460 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:37.275566 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1454/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:37.349882 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:37.359611 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0b3a-6ada-42d2-b92c-211d6a0d8845 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:37.363286 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:37.363814 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:37.364088 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:37.364357 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:37.383409 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:37.420772 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:37.422225 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555aa44e-0710-4824-9ec1-dfa33ffaed10 service cinder] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:37.430902 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1433/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:50:41.489607 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:41.550681 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a34db-76d0-44a3-8137-667cddad05ce service cinder] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:41.555165 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:41.555775 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:41.556048 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:41.556312 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] PATH_INFO: `/v3/users/b962e015507641e88a555951d139a288` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:41.557418 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b962e015507641e88a555951d139a288)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:41.559895 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:41.604150 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b962e015507641e88a555951d139a288'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:41.611899 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b962e015507641e88a555951d139a288'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:41.612500 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b962e015507641e88a555951d139a288'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:41.613096 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b962e015507641e88a555951d139a288'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:41.625857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b962e015507641e88a555951d139a288'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:41.638200 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1455/2888] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:41 2022] DELETE /identity/v3/users/b962e015507641e88a555951d139a288 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:41.642797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:41.643335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:41.643438 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:41.661810 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:41.662997 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:41.720781 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1434/2889] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:41.730374 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:41.732333 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:41.745866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:41.789346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff06ad8-dcf8-467d-bde6-fe18e1346cb5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:41.793673 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:41.794287 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:41.794562 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:41.794833 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:41.803414 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:41.804830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:41.814758 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1456/2890] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:42.077848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.079272 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:42.091656 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94642655-6455-4048-bf24-0038fb9c1d39 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:42.096239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:42.096857 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.097137 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.097408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] PATH_INFO: `/v3/projects/d2b9e3f2d1054be8b89c58c4ab73eb5d` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.099239 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b9e3f2d1054be8b89c58c4ab73eb5d)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:42.100830 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:42.150349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b9e3f2d1054be8b89c58c4ab73eb5d', 'request_id': 'req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.158183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b9e3f2d1054be8b89c58c4ab73eb5d', 'request_id': 'req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.164557 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b9e3f2d1054be8b89c58c4ab73eb5d', 'request_id': 'req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.175727 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] The token cache is being invalidate because project d2b9e3f2d1054be8b89c58c4ab73eb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:42.176014 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.176634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.178155 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1435/2891] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:42 2022] DELETE /identity/v3/projects/d2b9e3f2d1054be8b89c58c4ab73eb5d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:42.182129 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.191788 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba7657-9c4e-48ca-933c-6f09f7b81f76 service neutron] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:42.246630 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:42.247242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.247516 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.247785 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] PATH_INFO: `/v3/users/2d24275754ff4379a3f4eaf8d0317ec3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.248872 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d24275754ff4379a3f4eaf8d0317ec3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:42.250821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:42.295569 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d24275754ff4379a3f4eaf8d0317ec3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.302643 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d24275754ff4379a3f4eaf8d0317ec3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.303238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d24275754ff4379a3f4eaf8d0317ec3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.303836 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d24275754ff4379a3f4eaf8d0317ec3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.315416 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-5bca268c-e15c-4cdb-9795-cc07b35b17d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d24275754ff4379a3f4eaf8d0317ec3'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.327660 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1457/2892] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:42 2022] DELETE /identity/v3/users/2d24275754ff4379a3f4eaf8d0317ec3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:42.596010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.597431 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:42.610283 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f4dc8-7cdc-42f7-a067-b62d4455aa5f admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:42.651973 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:42.667918 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:42.668570 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.668845 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.669115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] PATH_INFO: `/v3/projects/28f99218ceb0446ab9c924c3db7e9a10` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.670303 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f99218ceb0446ab9c924c3db7e9a10)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:42.672140 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:42.720395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f99218ceb0446ab9c924c3db7e9a10', 'request_id': 'req-085b186d-f6d6-4fcb-b677-20db0dd1b845'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.727823 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f99218ceb0446ab9c924c3db7e9a10', 'request_id': 'req-085b186d-f6d6-4fcb-b677-20db0dd1b845'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.734624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f99218ceb0446ab9c924c3db7e9a10', 'request_id': 'req-085b186d-f6d6-4fcb-b677-20db0dd1b845'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.746018 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] The token cache is being invalidate because project 28f99218ceb0446ab9c924c3db7e9a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:42.746819 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.747455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-085b186d-f6d6-4fcb-b677-20db0dd1b845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:42.748946 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1436/2893] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:42 2022] DELETE /identity/v3/projects/28f99218ceb0446ab9c924c3db7e9a10 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:42.753787 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.754260 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.754368 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.774010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:42.775218 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:42.803059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:42.836010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1458/2894] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:42.846090 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.846601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.847066 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.871825 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:42.873352 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:42.883850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1437/2895] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:42.888825 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.898486 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cc000-e810-4f9b-8a87-6c4c9bb0477d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:42.903141 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:42.903742 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.904022 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.904296 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.904937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:42.905238 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:42.906929 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:42.918575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1459/2896] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:42.922800 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.931815 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25263c-168c-49dd-af61-233d8290d930 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:42.936921 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:42.937506 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:42.937821 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:42.938093 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:42.938719 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:42.940604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:42.967096 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1438/2897] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:42 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:42.971060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:42.981575 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2282-2484-47a5-a500-cc69b66c07b3 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.035679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.036271 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.036552 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.036854 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.037574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.039546 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.061291 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1460/2898] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:42 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:50:43.065384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.075601 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428682-96e8-4654-847e-d3f7fe58ac46 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.080301 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.080911 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.081186 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.081453 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.082144 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.083745 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.093415 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1439/2899] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:50:43.097094 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.107371 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327d07-7672-41fb-b621-b20e273e3b79 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.111930 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.112634 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.112916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.113188 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.113864 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.115436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f0a7d-8323-4a41-b4cc-9a661984b1eb admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.126407 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1461/2900] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:43.130418 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.140369 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b751a5f-1d0e-4175-977a-70482eb89361 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.145073 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.145702 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.146010 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.146281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] PATH_INFO: `/v3/projects/eae505c1e5234a7193208b1d92e6b943/users/d0bf7322eca34a17ada960f6ebcce23a/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.161270 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae505c1e5234a7193208b1d92e6b943, user_id=d0bf7322eca34a17ada960f6ebcce23a, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.164154 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.179384 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1440/2901] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:43 2022] PUT /identity/v3/projects/eae505c1e5234a7193208b1d92e6b943/users/d0bf7322eca34a17ada960f6ebcce23a/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:43.192917 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.193232 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.193533 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.221809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] MFA Rules not processed for user `d0bf7322eca34a17ada960f6ebcce23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:43.223024 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:43.285455 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1462/2902] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:43.289925 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.350361 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f76e62-beaf-47e2-8dde-2901ff4ca863 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.354817 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.355398 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.356246 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.356512 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] PATH_INFO: `/v3/projects` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.357122 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.359028 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.373287 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:43.386359 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1441/2903] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:43 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:43.390381 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.400970 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a248bd-434b-4a46-b2d6-a9e312d95505 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.427242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:43.457576 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.458138 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.458417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.458690 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] PATH_INFO: `/v3/users` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.459320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.461220 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.483916 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1463/2904] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:43 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:43.487433 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.498321 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2ca46-11b0-4256-86c0-34e05f39daab admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.502963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.503564 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.503843 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.504115 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.504758 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.506395 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.517104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1442/2905] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 15:50:43.521329 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.531949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5676f27-8779-4ec1-b1a4-aa024a7f0200 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.536549 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.537186 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.537461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.537753 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] PATH_INFO: `/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31/users/b3578b36a30849378a5935650796d814/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.553136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6f332bd98b4e5ba231de5e6b96de31, user_id=b3578b36a30849378a5935650796d814, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.555792 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.567963 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1464/2906] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:43 2022] PUT /identity/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31/users/b3578b36a30849378a5935650796d814/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:43.571862 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.581861 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23717ae-0923-4b00-9df6-c88145bf6d49 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.636597 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.639107 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.639406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.639742 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.640408 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.642019 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24be83-25ce-4d32-8651-d86fa36ced13 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.651848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1443/2907] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:43.656584 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.667002 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641f884-73ef-4d7e-a768-3d0c8366c94a admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.672139 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.672777 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.673052 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.673346 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] PATH_INFO: `/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31/users/b3578b36a30849378a5935650796d814/roles/4d009788d3b744b6974d4cd0673a0a5b` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.675297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6f332bd98b4e5ba231de5e6b96de31, user_id=b3578b36a30849378a5935650796d814, role_id=4d009788d3b744b6974d4cd0673a0a5b)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.677975 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.688317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1465/2908] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:43 2022] PUT /identity/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31/users/b3578b36a30849378a5935650796d814/roles/4d009788d3b744b6974d4cd0673a0a5b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:43.698539 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.699015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.699015 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.726104 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] MFA Rules not processed for user `b3578b36a30849378a5935650796d814`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:43.727281 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:43.794634 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1444/2909] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:43.805293 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:43.806980 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:43.862421 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8d9ec-93b9-4787-9d45-7daabca8f1c5 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:43.865979 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:43.866559 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:43.866832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:43.867101 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:43.875713 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:43.877115 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd096a3-20f9-4069-8538-2c593ce496ac service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:43.886458 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1466/2910] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:44.245801 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:44.306157 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5fb49-451c-4e0b-8886-87a609a6aab3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:44.311079 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:44.311797 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:44.312078 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:44.312350 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] PATH_INFO: `/v3/users/d0bf7322eca34a17ada960f6ebcce23a` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:44.313456 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bf7322eca34a17ada960f6ebcce23a)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:44.315394 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:44.320530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=100 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:44.362367 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bf7322eca34a17ada960f6ebcce23a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.369320 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bf7322eca34a17ada960f6ebcce23a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.381476 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bf7322eca34a17ada960f6ebcce23a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.382188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bf7322eca34a17ada960f6ebcce23a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.382804 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bf7322eca34a17ada960f6ebcce23a'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.396385 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1445/2911] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:44 2022] DELETE /identity/v3/users/d0bf7322eca34a17ada960f6ebcce23a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:44.401012 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:44.401297 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:44.401568 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:44.420261 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:44.421565 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:44.477679 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1467/2912] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:44.487785 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:44.489192 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:44.545963 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20946-9846-4d2a-8d4f-f9b9367e6d1d admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:44.549532 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:44.550159 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:44.550434 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:44.550701 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:44.560119 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:44.561607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:44.570993 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1446/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:50:44.832466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:44.834140 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:44.846835 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17468519-5326-4883-8634-2eb48fa3c7e7 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:44.851832 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:44.852495 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:44.852828 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:44.853107 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] PATH_INFO: `/v3/projects/eae505c1e5234a7193208b1d92e6b943` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:44.854281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae505c1e5234a7193208b1d92e6b943)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:44.857776 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:44.879345 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:44.905005 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae505c1e5234a7193208b1d92e6b943', 'request_id': 'req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.911210 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae505c1e5234a7193208b1d92e6b943', 'request_id': 'req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.922342 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae505c1e5234a7193208b1d92e6b943', 'request_id': 'req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.933524 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] The token cache is being invalidate because project eae505c1e5234a7193208b1d92e6b943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:44.933925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.934558 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:44.936042 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1468/2914] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:44 2022] DELETE /identity/v3/projects/eae505c1e5234a7193208b1d92e6b943 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:44.940150 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:44.949762 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24085efe-0124-4d6c-bd9f-505b00768b00 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.004441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.005053 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.005329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.005598 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] PATH_INFO: `/v3/users/b3578b36a30849378a5935650796d814` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.006794 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3578b36a30849378a5935650796d814)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.008764 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.040603 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:45.054848 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3578b36a30849378a5935650796d814'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.061520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3578b36a30849378a5935650796d814'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.073160 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3578b36a30849378a5935650796d814'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.073863 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3578b36a30849378a5935650796d814'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.074463 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-6e2ccb2a-4552-4847-9f11-6d0c16655d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3578b36a30849378a5935650796d814'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.086509 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1447/2915] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:50:44 2022] DELETE /identity/v3/users/b3578b36a30849378a5935650796d814 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:45.358656 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.360136 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:45.374453 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2a3e0-f6cc-40e4-85e9-d86c7abfb9f6 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.430436 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.431058 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.431335 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.431608 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] PATH_INFO: `/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.432727 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6f332bd98b4e5ba231de5e6b96de31)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.434680 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.479647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6f332bd98b4e5ba231de5e6b96de31', 'request_id': 'req-035e5398-a069-40e1-9810-b0d3524e9f27'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.485750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6f332bd98b4e5ba231de5e6b96de31', 'request_id': 'req-035e5398-a069-40e1-9810-b0d3524e9f27'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.492829 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6f332bd98b4e5ba231de5e6b96de31', 'request_id': 'req-035e5398-a069-40e1-9810-b0d3524e9f27'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.502902 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] The token cache is being invalidate because project 6b6f332bd98b4e5ba231de5e6b96de31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:50:45.503187 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.503809 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-035e5398-a069-40e1-9810-b0d3524e9f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:50:45.505319 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1469/2916] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:50:45 2022] DELETE /identity/v3/projects/6b6f332bd98b4e5ba231de5e6b96de31 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:45.510292 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.510572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.510842 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.531152 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:45.532471 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:45.592641 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1448/2917] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:45.600369 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.600677 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.600952 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.620357 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:45.622062 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:45.629647 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1470/2918] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:45.633652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.643695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ab7ee-ff6b-48d2-ab48-4753c91600e3 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.648062 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.648636 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.648909 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.649175 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.649846 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:50:45.650151 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.651712 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.662738 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1449/2919] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:50:45.667010 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.676170 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9bf7a-ffc0-4443-86a9-4d5c00f15760 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.680725 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.681318 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.681591 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.681889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.682545 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.684949 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.716133 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1471/2920] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:50:45 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 15:50:45.718063 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.727890 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e1ef-df33-46f3-b452-6daa5e68f8f1 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.783347 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.783937 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.784214 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.784487 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.785114 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.787042 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.807644 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1450/2921] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:50:45 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:50:45.812473 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.825174 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1639f3-85dc-4a1c-9f3d-ff72882ab63f admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.830425 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.831459 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.831976 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.832285 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.832933 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.835173 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.838317 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:45.847977 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1472/2922] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:45.851604 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.861546 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63865da4-2158-4a7e-b337-7f94a4040fe8 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.866091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.866673 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.866947 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.867213 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.867865 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.869428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597ce92-c638-45fc-ba1c-d174591d6a0f admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.880386 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1451/2923] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:50:45.884461 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:45.895120 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27edf-3136-43d1-90b7-a71cdb7f330c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:45.899778 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:45.900411 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.900689 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.900965 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] PATH_INFO: `/v3/projects/6a330e19f6bc40ce9b14eba8e211d2a3/users/895b5d155e5f49d4a3341fd27e2d65f5/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.915090 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a330e19f6bc40ce9b14eba8e211d2a3, user_id=895b5d155e5f49d4a3341fd27e2d65f5, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:45.918025 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:45.930574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1473/2924] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:50:45 2022] PUT /identity/v3/projects/6a330e19f6bc40ce9b14eba8e211d2a3/users/895b5d155e5f49d4a3341fd27e2d65f5/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:50:45.942609 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:45.943089 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:45.943188 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:45.969607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:45.972628 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] MFA Rules not processed for user `895b5d155e5f49d4a3341fd27e2d65f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:50:45.974645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:46.047017 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1452/2925] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:50:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:50:46.059434 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:50:46.061109 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:50:46.138625 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba69276-7385-4132-9e34-159cecd6a0dc admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:50:46.142160 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '039bd7079482417f8fc2727ee1ee1c31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:50:46.142757 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:50:46.143034 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:50:46.143302 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:50:46.151385 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:50:46.152816 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9762fa-9b41-49b8-83d6-ace211ebf291 service glance] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:50:46.161405 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1474/2926] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 15:50:56.044086 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=26 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:50:56.157417 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=46,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:11.854360 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:11.914886 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9189628-6ac2-4f39-9216-f777dd27dc27 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:11.920197 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:11.920809 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:11.921112 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:11.921380 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] PATH_INFO: `/v3/users/895b5d155e5f49d4a3341fd27e2d65f5` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:11.922530 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895b5d155e5f49d4a3341fd27e2d65f5)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:11.924441 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:11.969525 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895b5d155e5f49d4a3341fd27e2d65f5'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:11.976329 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895b5d155e5f49d4a3341fd27e2d65f5'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:11.988681 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895b5d155e5f49d4a3341fd27e2d65f5'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:11.989335 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895b5d155e5f49d4a3341fd27e2d65f5'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:11.989975 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895b5d155e5f49d4a3341fd27e2d65f5'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.002966 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1453/2927] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:51:11 2022] DELETE /identity/v3/users/895b5d155e5f49d4a3341fd27e2d65f5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:51:12.007913 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.008424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.008997 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.029863 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:51:12.031057 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:12.088466 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1475/2928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 15:51:12.098917 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.100406 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:12.155695 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74d905-22ef-41cb-8647-09f592763c99 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.159171 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.159777 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.160051 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.160317 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.169874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.171282 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c017d4-3b17-4a42-802f-8a0e19661006 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.180355 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1454/2929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:51:12.441315 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.442801 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:12.454937 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787fa41b-cced-40c8-992c-a669db01f821 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.459542 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.465623 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.466551 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.466830 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] PATH_INFO: `/v3/projects/6a330e19f6bc40ce9b14eba8e211d2a3` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.468060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a330e19f6bc40ce9b14eba8e211d2a3)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.470007 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.516554 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a330e19f6bc40ce9b14eba8e211d2a3', 'request_id': 'req-905db6e8-a6d6-4d63-a20c-70c6d5898309'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.522511 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a330e19f6bc40ce9b14eba8e211d2a3', 'request_id': 'req-905db6e8-a6d6-4d63-a20c-70c6d5898309'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.529925 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a330e19f6bc40ce9b14eba8e211d2a3', 'request_id': 'req-905db6e8-a6d6-4d63-a20c-70c6d5898309'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.540098 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] The token cache is being invalidate because project 6a330e19f6bc40ce9b14eba8e211d2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:51:12.540383 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.541257 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-905db6e8-a6d6-4d63-a20c-70c6d5898309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:12.542751 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1476/2930] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:51:12 2022] DELETE /identity/v3/projects/6a330e19f6bc40ce9b14eba8e211d2a3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:51:12.548027 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.548305 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.548607 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.568264 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:51:12.569455 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:12.586313 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:12.629131 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1455/2931] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:51:12.636624 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.636909 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.637182 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.656961 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:51:12.658201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:12.666408 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1477/2932] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:51:12.670930 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.681325 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7514-41de-4ab2-9955-bc8f6848c2f6 None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.688850 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.689795 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.690231 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.690652 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] PATH_INFO: `/v3/domains` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.691659 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 15:51:12.692091 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.693683 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.706551 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1456/2933] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 15:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 15:51:12.710874 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.720059 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488bd78-2e69-4ded-97b0-1d694bc43f4d None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.724626 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.725213 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.725493 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.725798 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.726447 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.728390 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.757242 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1478/2934] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:51:12.761446 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.772035 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb828f1-e43c-4c64-8576-a4c81036b53b admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.827572 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.828166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.828443 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.828714 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.829349 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.831285 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.851567 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1457/2935] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 15:51:12.855765 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.865962 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce9169-1775-4c98-b7b5-941c4acd5c9c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.870563 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.871147 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.871424 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.871696 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.872857 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.874465 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.884201 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1479/2936] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:51:12.888520 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.898183 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d873b1-b8c8-4cf6-a6f2-32e83f2160c7 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.903084 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.903631 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.903915 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.904189 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.904828 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.906493 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274a3b2-7e23-45e5-a033-3d9cf87164d4 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.917248 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1458/2937] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 15:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 15:51:12.921764 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:12.931485 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3be5b5-57dd-4d94-ab68-e7b7be3b74f2 admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:12.936629 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:12.937267 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] REQUEST_METHOD: `PUT` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.937550 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.937866 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] PATH_INFO: `/v3/projects/87a02a7f76ed4345a908c3e9380f2d81/users/b0be7f03cca44a0da8c646cef27d3f2f/roles/85c18124c6384ec5be995afe6ae23067` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:12.952111 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a02a7f76ed4345a908c3e9380f2d81, user_id=b0be7f03cca44a0da8c646cef27d3f2f, role_id=85c18124c6384ec5be995afe6ae23067)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:12.954807 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:12.968362 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1480/2938] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 15:51:12 2022] PUT /identity/v3/projects/87a02a7f76ed4345a908c3e9380f2d81/users/b0be7f03cca44a0da8c646cef27d3f2f/roles/85c18124c6384ec5be995afe6ae23067 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:51:12.979874 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] REQUEST_METHOD: `POST` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:12.980156 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:12.980428 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:13.011887 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.auth.core [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] MFA Rules not processed for user `b0be7f03cca44a0da8c646cef27d3f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:51:13.013094 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:13.074671 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1459/2939] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:51:13.086017 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:13.087821 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:13.111462 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:13.147230 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462b4fe-3132-4aa0-a95c-dfbf2289d85c admin admin] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:13.150772 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57733217d148407dbc9bce988253441e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:13.151344 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] REQUEST_METHOD: `GET` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:13.151622 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:13.151889 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:13.159995 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:13.161401 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995fc3b-a138-4425-afc7-032b63d9a8ab service cinder] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:13.170651 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1481/2940] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:51:23.071896 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:23.166320 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=17 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:46.090101 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:46.151243 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd862d9-3088-4be6-9e10-5004780ffadd None None] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:46.155623 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:46.156232 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:46.156510 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:46.156779 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] PATH_INFO: `/v3/users/b0be7f03cca44a0da8c646cef27d3f2f` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:46.157914 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0be7f03cca44a0da8c646cef27d3f2f)` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:46.159833 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:46.205851 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0be7f03cca44a0da8c646cef27d3f2f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.212679 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0be7f03cca44a0da8c646cef27d3f2f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.224645 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0be7f03cca44a0da8c646cef27d3f2f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.225302 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0be7f03cca44a0da8c646cef27d3f2f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.225957 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.notifications [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0be7f03cca44a0da8c646cef27d3f2f'} {{(pid=81335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.238847 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1460/2941] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 15:51:46 2022] DELETE /identity/v3/users/b0be7f03cca44a0da8c646cef27d3f2f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:51:46.243281 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] REQUEST_METHOD: `POST` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:46.243805 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:46.243915 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:46.263131 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.auth.core [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] MFA Rules not processed for user `3fd5e886cff94b13acb51e443452da3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 15:51:46.264324 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:46.320840 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1482/2942] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 15:51:46.330675 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:46.332080 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:46.387442 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80655-4885-4cef-b3d0-f38bf33d1f89 admin admin] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:46.391032 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac90a40ddbfb4c79bc6941adb9498146', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:46.391624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:46.391903 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:46.392174 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:46.400900 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:46.402362 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:46.411468 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1461/2943] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:51:46.676600 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] Authenticating user token {{(pid=81336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:51:46.678106 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.fernet_utils [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:51:46.695085 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e31c9-c525-4ddf-9b38-66a8a5667db8 None None] Validating token access rules against request {{(pid=81336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:51:46.701069 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fd5e886cff94b13acb51e443452da3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27ae4d0f7c2945c3a5c26ee841ef1a26', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:51:46.701750 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:51:46.702060 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:51:46.702353 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] PATH_INFO: `/v3/projects/87a02a7f76ed4345a908c3e9380f2d81` {{(pid=81336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:51:46.703472 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a02a7f76ed4345a908c3e9380f2d81)` {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:51:46.705341 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] RBAC: Authorization granted {{(pid=81336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:51:46.752611 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a02a7f76ed4345a908c3e9380f2d81', 'request_id': 'req-2c02b8d6-836e-43bf-8485-38d98564fde8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.758674 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a02a7f76ed4345a908c3e9380f2d81', 'request_id': 'req-2c02b8d6-836e-43bf-8485-38d98564fde8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.767043 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a02a7f76ed4345a908c3e9380f2d81', 'request_id': 'req-2c02b8d6-836e-43bf-8485-38d98564fde8'} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.777512 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] The token cache is being invalidate because project 87a02a7f76ed4345a908c3e9380f2d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 15:51:46.777841 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.778503 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG keystone.notifications [None req-2c02b8d6-836e-43bf-8485-38d98564fde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 15:51:46.780014 dv-cinder-851996-10-smb devstack@keystone.service[81336]: [pid: 81336|app: 0|req: 1483/2944] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 15:51:46 2022] DELETE /identity/v3/projects/87a02a7f76ed4345a908c3e9380f2d81 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 15:51:56.407901 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:51:56.774574 dv-cinder-851996-10-smb devstack@keystone.service[81336]: DEBUG dbcounter [-] [81336] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 15:55:31.902253 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] Authenticating user token {{(pid=81335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 15:55:31.903676 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:55:32.028039 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f09890-bb28-4cca-9f4e-15fe62676561 service neutron] Validating token access rules against request {{(pid=81335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 15:55:32.086972 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124f41a738ee4b998ecddc566b09d78c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '012215e5533343f79ff567e18eb4251d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 15:55:32.087624 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] REQUEST_METHOD: `GET` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 15:55:32.087899 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] SCRIPT_NAME: `/identity` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 15:55:32.088166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 15:55:32.089880 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.fernet_utils [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 15:55:32.101184 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 15:55:32.102775 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57e874-6bcf-40ae-812b-e1b04981ab1a service placement] RBAC: Authorization granted {{(pid=81335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 15:55:32.113011 dv-cinder-851996-10-smb devstack@keystone.service[81335]: [pid: 81335|app: 0|req: 1462/2945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 15:55:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 15:55:42.108166 dv-cinder-851996-10-smb devstack@keystone.service[81335]: DEBUG dbcounter [-] [81335] Writing DB stats keystone:SELECT=84 {{(pid=81335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}